[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:13:55 dist-test-slave-rwrg krb5kdc[18157](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:13:55 dist-test-slave-rwrg krb5kdc[18157](info): set up 2 sockets
Aug 12 01:13:55 dist-test-slave-rwrg krb5kdc[18157](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 01:13:57.287627 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.374s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:13:57 dist-test-slave-rwrg krb5kdc[18157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497237, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:13:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:13:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:13:57.415560 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:46353
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:34583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:46353
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:13:57.499181 18178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:13:57.499408 18178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:13:57.499429 18178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:13:57.500641 18178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:13:57.500689 18178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:13:57.500703 18178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:13:57.500716 18178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:13:57.500805 18178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:13:57.502333 18178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:34583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:46353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:46353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:13:57.502616 18178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:13:57.502864 18178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:13:57.508210 18202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:13:57.508335 18200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:13:57.508402 18178 server_base.cc:1034] running on GCE node
W20260812 01:13:57.508270 18199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:13:57.508737 18178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:13:57.509093 18178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:13:57.510236 18178 hybrid_clock.cc:648] HybridClock initialized: now 1786497237510223 us; error 103 us; skew 500 ppm
Aug 12 01:13:57 dist-test-slave-rwrg krb5kdc[18157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497237, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:13:57.516798 18178 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:13:57.517238 18178 webserver.cc:460] Webserver started at http://127.17.183.190:42617/ using document root <none> and password file <none>
I20260812 01:13:57.517472 18178 fs_manager.cc:359] Metadata directory not provided
I20260812 01:13:57.517518 18178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:13:57.517695 18178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:13:57.518863 18178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "7f3d3cf17c614fbcb2934b995ec4e69a"
format_stamp: "Formatted at 2026-08-12 01:13:57 on dist-test-slave-rwrg"
server_key: "2f82d0a9b60a3e3ca7f4a9222b22fb2d"
server_key_iv: "86941bbdfbff4e71ec47a85ca3602d6e"
server_key_version: "encryptionkey@0"
I20260812 01:13:57.519237 18178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "7f3d3cf17c614fbcb2934b995ec4e69a"
format_stamp: "Formatted at 2026-08-12 01:13:57 on dist-test-slave-rwrg"
server_key: "2f82d0a9b60a3e3ca7f4a9222b22fb2d"
server_key_iv: "86941bbdfbff4e71ec47a85ca3602d6e"
server_key_version: "encryptionkey@0"
I20260812 01:13:57.520862 18178 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260812 01:13:57.521754 18220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:13:57.522019 18178 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:13:57.522120 18178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "7f3d3cf17c614fbcb2934b995ec4e69a"
format_stamp: "Formatted at 2026-08-12 01:13:57 on dist-test-slave-rwrg"
server_key: "2f82d0a9b60a3e3ca7f4a9222b22fb2d"
server_key_iv: "86941bbdfbff4e71ec47a85ca3602d6e"
server_key_version: "encryptionkey@0"
I20260812 01:13:57.522197 18178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:13:57.531957 18178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:13:57.533947 18178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:13:57.534096 18178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:13:57.538861 18178 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:46353
I20260812 01:13:57.538908 18321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:46353 every 8 connection(s)
I20260812 01:13:57.539268 18178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:13:57.540231 18325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:13:57.540900 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 18178
I20260812 01:13:57.541010 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:13:57.541620 18142 external_mini_cluster.cc:1428] Setting key 05a8fa839c2014168dde83080108d107
I20260812 01:13:57.543185 18325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a: Bootstrap starting.
I20260812 01:13:57.543783 18325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a: Neither blocks nor log segments found. Creating new log.
I20260812 01:13:57.544102 18325 log.cc:824] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a: Log is configured to *not* fsync() on all Append() calls
I20260812 01:13:57.544922 18325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a: No bootstrap required, opened a new log
I20260812 01:13:57.546600 18325 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3d3cf17c614fbcb2934b995ec4e69a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46353 } }
I20260812 01:13:57.546757 18325 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:13:57.546806 18325 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f3d3cf17c614fbcb2934b995ec4e69a, State: Initialized, Role: FOLLOWER
I20260812 01:13:57.546944 18325 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3d3cf17c614fbcb2934b995ec4e69a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46353 } }
I20260812 01:13:57.547043 18325 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:13:57.547094 18325 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:13:57.547183 18325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:13:57.547948 18325 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3d3cf17c614fbcb2934b995ec4e69a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46353 } }
I20260812 01:13:57.548092 18325 leader_election.cc:302] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f3d3cf17c614fbcb2934b995ec4e69a; no voters:
I20260812 01:13:57.548264 18325 leader_election.cc:288] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:13:57.548331 18338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:13:57.548482 18338 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [term 1 LEADER]: Becoming Leader. State: Replica: 7f3d3cf17c614fbcb2934b995ec4e69a, State: Running, Role: LEADER
I20260812 01:13:57.548516 18325 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:13:57.550001 18338 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3d3cf17c614fbcb2934b995ec4e69a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46353 } }
I20260812 01:13:57.550630 18341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f3d3cf17c614fbcb2934b995ec4e69a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3d3cf17c614fbcb2934b995ec4e69a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46353 } } }
I20260812 01:13:57.550781 18341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [sys.catalog]: This master's current role is: LEADER
I20260812 01:13:57.551020 18340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f3d3cf17c614fbcb2934b995ec4e69a. Latest consensus state: current_term: 1 leader_uuid: "7f3d3cf17c614fbcb2934b995ec4e69a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3d3cf17c614fbcb2934b995ec4e69a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46353 } } }
I20260812 01:13:57.551151 18340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a [sys.catalog]: This master's current role is: LEADER
W20260812 01:13:57.551425 18356 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:13:57.551491 18356 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:13:57.551574 18357 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:13:57.551772 18357 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:13:57.553376 18357 catalog_manager.cc:1347] Generated new cluster ID: 81d601d5be7d432ca6ed81b044cd39ca
I20260812 01:13:57.553429 18357 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:13:57 dist-test-slave-rwrg krb5kdc[18157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497237, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:13:57.560482 18328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:13:57.542687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34620 (local address 127.17.183.190:46353)
0812 01:13:57.542855 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 01:13:57.542865 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:13:57.543114 (+ 249us) server_negotiation.cc:407] Connection header received
0812 01:13:57.545428 (+ 2314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:13:57.545435 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:13:57.545482 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:13:57.545633 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:13:57.547197 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:57.548912 (+ 1715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:57.550031 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:57.550740 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:57.551963 (+ 1223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:13:57.555403 (+ 3440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:13:57.555407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:13:57.555408 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:13:57.555419 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:13:57.557620 (+ 2201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:57.558167 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:57.558170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:57.558170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:57.558279 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:57.558632 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:57.558633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:57.558633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:57.558980 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:13:57.560055 (+ 1075us) server_negotiation.cc:1035] Waiting for connection context
0812 01:13:57.560139 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 01:13:57.560284 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260812 01:13:57.570607 18357 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:13:57.571130 18357 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:13:57.584302 18357 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f3d3cf17c614fbcb2934b995ec4e69a: Generated new TSK 0
I20260812 01:13:57.584672 18357 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:13:57.617647 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46353
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:34583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:13:57.729874 18366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:13:57.730232 18366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:13:57.730280 18366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:13:57.731530 18366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:13:57.731609 18366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:13:57.731657 18366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:13:57.733273 18366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:34583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46353
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:13:57.733553 18366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:13:57.733803 18366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:13:57.740446 18378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:13:57.740520 18374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:13:57.740603 18372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:13:57.741053 18366 server_base.cc:1034] running on GCE node
I20260812 01:13:57.741233 18366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:13:57.741488 18366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:13:57.742723 18366 hybrid_clock.cc:648] HybridClock initialized: now 1786497237742723 us; error 44 us; skew 500 ppm
Aug 12 01:13:57 dist-test-slave-rwrg krb5kdc[18157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497237, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:13:57.745641 18366 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:13:57.746055 18366 webserver.cc:460] Webserver started at http://127.17.183.129:35773/ using document root <none> and password file <none>
I20260812 01:13:57.746245 18366 fs_manager.cc:359] Metadata directory not provided
I20260812 01:13:57.746285 18366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:13:57.746376 18366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:13:57.747499 18366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "faa145ae36014ff1b5f3be4c6e41a5d2"
format_stamp: "Formatted at 2026-08-12 01:13:57 on dist-test-slave-rwrg"
server_key: "b61791c0d9915b554d83db18de1790f9"
server_key_iv: "0fd992550dd26072ce68a9de01277d6f"
server_key_version: "encryptionkey@0"
I20260812 01:13:57.747864 18366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "faa145ae36014ff1b5f3be4c6e41a5d2"
format_stamp: "Formatted at 2026-08-12 01:13:57 on dist-test-slave-rwrg"
server_key: "b61791c0d9915b554d83db18de1790f9"
server_key_iv: "0fd992550dd26072ce68a9de01277d6f"
server_key_version: "encryptionkey@0"
I20260812 01:13:57.749563 18366 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 01:13:57.750430 18391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:13:57.750677 18366 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:13:57.750759 18366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "faa145ae36014ff1b5f3be4c6e41a5d2"
format_stamp: "Formatted at 2026-08-12 01:13:57 on dist-test-slave-rwrg"
server_key: "b61791c0d9915b554d83db18de1790f9"
server_key_iv: "0fd992550dd26072ce68a9de01277d6f"
server_key_version: "encryptionkey@0"
I20260812 01:13:57.750814 18366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:13:57.762871 18366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:13:57.764853 18366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:13:57.764966 18366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:13:57.765203 18366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:13:57.765530 18366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:13:57.765563 18366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:13:57.765626 18366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:13:57.765656 18366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:13:57.775184 18366 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:33705
I20260812 01:13:57.775238 18629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:33705 every 8 connection(s)
I20260812 01:13:57.775576 18366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
Aug 12 01:13:57 dist-test-slave-rwrg krb5kdc[18157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497237, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:13:57.784358 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 18366
I20260812 01:13:57.784456 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:13:57.784654 18142 external_mini_cluster.cc:1428] Setting key 9c3dbbeaf3bb717f67a9f132f43dbad3
I20260812 01:13:57.785426 18328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:13:57.776466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:44613 (local address 127.17.183.190:46353)
0812 01:13:57.776560 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 01:13:57.776562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:13:57.776793 (+ 231us) server_negotiation.cc:407] Connection header received
0812 01:13:57.777427 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:13:57.777428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:13:57.777437 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:13:57.777497 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:13:57.778532 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:57.779021 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:57.780045 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:57.780243 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:57.780294 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:13:57.782551 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:13:57.782552 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:13:57.782565 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:13:57.782572 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:13:57.783765 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:57.784148 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:57.784149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:57.784149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:57.784199 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:57.784545 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:57.784547 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:57.784547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:57.784763 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:13:57.784817 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 01:13:57.785225 (+ 408us) server_negotiation.cc:299] Negotiation successful
0812 01:13:57.785327 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:13:57.785591 18633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:13:57.776417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:46353 (local address 127.17.183.129:44613)
0812 01:13:57.776636 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 01:13:57.776680 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:13:57.777337 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:13:57.777549 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:13:57.777552 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:13:57.778211 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:13:57.778444 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:13:57.778450 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:13:57.779101 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:13:57.779102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:13:57.779966 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:13:57.779968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:13:57.780315 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:13:57.780316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:13:57.780410 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:13:57.780977 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:13:57.780985 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:13:57.782460 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:13:57.783847 (+ 1387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:13:57.783853 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:13:57.783855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:13:57.784083 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:13:57.784267 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:13:57.784268 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:13:57.784268 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:13:57.784413 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:13:57.784889 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:13:57.784895 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:13:57.785070 (+ 175us) client_negotiation.cc:769] Sending connection context
0812 01:13:57.785160 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 01:13:57.785293 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":141,"threads_started":1}
I20260812 01:13:57.786137 18630 heartbeater.cc:347] Connected to a master server at 127.17.183.190:46353
I20260812 01:13:57.786247 18630 heartbeater.cc:464] Registering TS with master...
I20260812 01:13:57.786418 18630 heartbeater.cc:511] Master 127.17.183.190:46353 requested a full tablet report, sending...
I20260812 01:13:57.787003 18249 ts_manager.cc:194] Registered new tserver with Master: faa145ae36014ff1b5f3be4c6e41a5d2 (127.17.183.129:33705)
I20260812 01:13:57.787945 18249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:44613
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:13:57.814729 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46353
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:34583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:13:57.911139 18637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:13:57.911358 18637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:13:57.911384 18637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:13:57.912573 18637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:13:57.912621 18637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:13:57.912681 18637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:13:57.914417 18637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:34583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46353
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:13:57.914691 18637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:13:57.914947 18637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:13:57.920853 18656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:13:57.920817 18650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:13:57.920868 18637 server_base.cc:1034] running on GCE node
W20260812 01:13:57.920820 18648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:13:57.921334 18637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:13:57.921594 18637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:13:57.922766 18637 hybrid_clock.cc:648] HybridClock initialized: now 1786497237922755 us; error 50 us; skew 500 ppm
Aug 12 01:13:57 dist-test-slave-rwrg krb5kdc[18157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497237, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:13:57.925719 18637 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:13:57.926209 18637 webserver.cc:460] Webserver started at http://127.17.183.130:35001/ using document root <none> and password file <none>
I20260812 01:13:57.926443 18637 fs_manager.cc:359] Metadata directory not provided
I20260812 01:13:57.926524 18637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:13:57.926682 18637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:13:57.927855 18637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "7c9eb1de1e1b41babea50919cc7ef85f"
format_stamp: "Formatted at 2026-08-12 01:13:57 on dist-test-slave-rwrg"
server_key: "0267b7005d71471b936dc4ab133f78ba"
server_key_iv: "299b4e61272d98a43e654866de1ff067"
server_key_version: "encryptionkey@0"
I20260812 01:13:57.928285 18637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "7c9eb1de1e1b41babea50919cc7ef85f"
format_stamp: "Formatted at 2026-08-12 01:13:57 on dist-test-slave-rwrg"
server_key: "0267b7005d71471b936dc4ab133f78ba"
server_key_iv: "299b4e61272d98a43e654866de1ff067"
server_key_version: "encryptionkey@0"
I20260812 01:13:57.929857 18637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:13:57.930756 18668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:13:57.930981 18637 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:13:57.931094 18637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "7c9eb1de1e1b41babea50919cc7ef85f"
format_stamp: "Formatted at 2026-08-12 01:13:57 on dist-test-slave-rwrg"
server_key: "0267b7005d71471b936dc4ab133f78ba"
server_key_iv: "299b4e61272d98a43e654866de1ff067"
server_key_version: "encryptionkey@0"
I20260812 01:13:57.931170 18637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:13:57.939294 18637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:13:57.941397 18637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:13:57.941576 18637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:13:57.941836 18637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:13:57.942169 18637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:13:57.942226 18637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:13:57.942277 18637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:13:57.942322 18637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:13:57.951735 18637 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:37289
I20260812 01:13:57.951799 18865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:37289 every 8 connection(s)
I20260812 01:13:57.952106 18637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
Aug 12 01:13:57 dist-test-slave-rwrg krb5kdc[18157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497237, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:13:57.960602 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 18637
I20260812 01:13:57.960713 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:13:57.960906 18142 external_mini_cluster.cc:1428] Setting key 284d9d2a775b6d31b947ee8139155290
I20260812 01:13:57.962296 18328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:13:57.953039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:35057 (local address 127.17.183.190:46353)
0812 01:13:57.953098 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 01:13:57.953100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:13:57.953377 (+ 277us) server_negotiation.cc:407] Connection header received
0812 01:13:57.954109 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:13:57.954110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:13:57.954120 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:13:57.954180 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:13:57.955285 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:57.955768 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:57.956906 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:57.957090 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:57.957148 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:13:57.959320 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:13:57.959322 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:13:57.959322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:13:57.959328 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:13:57.960602 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:57.961111 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:57.961112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:57.961112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:57.961248 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:57.961561 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:57.961562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:57.961562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:57.961733 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:13:57.961819 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 01:13:57.962078 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 01:13:57.962169 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 01:13:57.962318 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:13:57.953009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:46353 (local address 127.17.183.130:35057)
0812 01:13:57.953231 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 01:13:57.953277 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 01:13:57.954014 (+ 737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:13:57.954262 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:13:57.954266 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:13:57.954877 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:13:57.955183 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:13:57.955189 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:13:57.955865 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:13:57.955867 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:13:57.956822 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:13:57.956825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:13:57.957168 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:13:57.957169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:13:57.957295 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:13:57.957803 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:13:57.957811 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:13:57.959231 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:13:57.960682 (+ 1451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:13:57.960691 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:13:57.960694 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:13:57.961030 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:13:57.961326 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:13:57.961328 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:13:57.961328 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:13:57.961462 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:13:57.961815 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:13:57.961821 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:13:57.961939 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 01:13:57.962028 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 01:13:57.962161 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":106,"threads_started":1}
I20260812 01:13:57.962841 18867 heartbeater.cc:347] Connected to a master server at 127.17.183.190:46353
I20260812 01:13:57.962952 18867 heartbeater.cc:464] Registering TS with master...
I20260812 01:13:57.963150 18867 heartbeater.cc:511] Master 127.17.183.190:46353 requested a full tablet report, sending...
I20260812 01:13:57.963573 18249 ts_manager.cc:194] Registered new tserver with Master: 7c9eb1de1e1b41babea50919cc7ef85f (127.17.183.130:37289)
I20260812 01:13:57.964146 18249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:35057
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:13:57.988781 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46353
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:34583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:13:58.087366 18878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:13:58.087589 18878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:13:58.087615 18878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:13:58.088799 18878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:13:58.088840 18878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:13:58.088867 18878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:13:58.090360 18878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:34583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46353
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:13:58.090572 18878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:13:58.090759 18878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:13:58.096098 18889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:13:58.096069 18891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:13:58.096163 18878 server_base.cc:1034] running on GCE node
W20260812 01:13:58.096355 18888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:13:58.096616 18878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:13:58.096918 18878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:13:58.098066 18878 hybrid_clock.cc:648] HybridClock initialized: now 1786497238098054 us; error 30 us; skew 500 ppm
Aug 12 01:13:58 dist-test-slave-rwrg krb5kdc[18157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497238, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:13:58.100739 18878 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:13:58.101218 18878 webserver.cc:460] Webserver started at http://127.17.183.131:42267/ using document root <none> and password file <none>
I20260812 01:13:58.101423 18878 fs_manager.cc:359] Metadata directory not provided
I20260812 01:13:58.101464 18878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:13:58.101554 18878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:13:58.102572 18878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "f8cb249e53bf42389ce86d047f447a46"
format_stamp: "Formatted at 2026-08-12 01:13:58 on dist-test-slave-rwrg"
server_key: "52c0b3ef11fe8e075af94b1b71376baa"
server_key_iv: "28784020795255344d7482362449cb94"
server_key_version: "encryptionkey@0"
I20260812 01:13:58.102874 18878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "f8cb249e53bf42389ce86d047f447a46"
format_stamp: "Formatted at 2026-08-12 01:13:58 on dist-test-slave-rwrg"
server_key: "52c0b3ef11fe8e075af94b1b71376baa"
server_key_iv: "28784020795255344d7482362449cb94"
server_key_version: "encryptionkey@0"
I20260812 01:13:58.104315 18878 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 01:13:58.105091 18907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:13:58.105293 18878 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 01:13:58.105384 18878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "f8cb249e53bf42389ce86d047f447a46"
format_stamp: "Formatted at 2026-08-12 01:13:58 on dist-test-slave-rwrg"
server_key: "52c0b3ef11fe8e075af94b1b71376baa"
server_key_iv: "28784020795255344d7482362449cb94"
server_key_version: "encryptionkey@0"
I20260812 01:13:58.105459 18878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:13:58.125320 18878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:13:58.127518 18878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:13:58.127704 18878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:13:58.128022 18878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:13:58.128360 18878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:13:58.128414 18878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:13:58.128463 18878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:13:58.128486 18878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:13:58.138129 18878 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:44263
I20260812 01:13:58.138218 19135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:44263 every 8 connection(s)
I20260812 01:13:58.138532 18878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:13:58.144667 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 18878
I20260812 01:13:58.144759 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:13:58.144933 18142 external_mini_cluster.cc:1428] Setting key 78ea99c53bd4a42d70d361315b1d4180
Aug 12 01:13:58 dist-test-slave-rwrg krb5kdc[18157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497238, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:13:58.148277 18328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:13:58.139304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:37707 (local address 127.17.183.190:46353)
0812 01:13:58.139354 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 01:13:58.139356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:13:58.139572 (+ 216us) server_negotiation.cc:407] Connection header received
0812 01:13:58.140173 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:13:58.140174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:13:58.140183 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:13:58.140243 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:13:58.141366 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:58.141859 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:58.142887 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:58.143062 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:58.143110 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:13:58.145534 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:13:58.145535 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:13:58.145536 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:13:58.145543 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:13:58.147098 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:58.147485 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:58.147486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:58.147486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:58.147539 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:58.147762 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:58.147763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:58.147763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:58.147863 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:13:58.147914 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:13:58.148146 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 01:13:58.148208 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:13:58.148587 19139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:13:58.139262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:46353 (local address 127.17.183.131:37707)
0812 01:13:58.139431 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 01:13:58.139475 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:13:58.140085 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:13:58.140296 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:13:58.140300 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:13:58.141035 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:13:58.141273 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:13:58.141279 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:13:58.141956 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:13:58.141956 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:13:58.142775 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:13:58.142777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:13:58.143134 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:13:58.143135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:13:58.143278 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:13:58.143762 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:13:58.143770 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:13:58.145433 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:13:58.147184 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:13:58.147190 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:13:58.147192 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:13:58.147415 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:13:58.147600 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:13:58.147601 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:13:58.147601 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:13:58.147701 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:13:58.147920 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:13:58.147924 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:13:58.148036 (+ 112us) client_negotiation.cc:769] Sending connection context
0812 01:13:58.148115 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 01:13:58.148244 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260812 01:13:58.149174 19136 heartbeater.cc:347] Connected to a master server at 127.17.183.190:46353
I20260812 01:13:58.149271 19136 heartbeater.cc:464] Registering TS with master...
I20260812 01:13:58.149422 19136 heartbeater.cc:511] Master 127.17.183.190:46353 requested a full tablet report, sending...
I20260812 01:13:58.149858 18249 ts_manager.cc:194] Registered new tserver with Master: f8cb249e53bf42389ce86d047f447a46 (127.17.183.131:44263)
I20260812 01:13:58.150287 18249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:37707
I20260812 01:13:58.157051 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 01:13:58 dist-test-slave-rwrg krb5kdc[18157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497238, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 01:13:58 dist-test-slave-rwrg krb5kdc[18157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497238, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:13:58.182364 19153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:13:58.174686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46202 (local address 127.17.183.129:33705)
0812 01:13:58.174871 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 01:13:58.174877 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:13:58.174908 (+ 31us) server_negotiation.cc:407] Connection header received
0812 01:13:58.174938 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:13:58.174939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:13:58.174954 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:13:58.175036 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:13:58.175611 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:58.176358 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:58.177124 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:58.177458 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:58.177517 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:13:58.179787 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:13:58.179795 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:13:58.179795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:13:58.179801 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:13:58.181353 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:58.181675 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:58.181677 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:58.181678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:58.181735 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:58.181915 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:58.181916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:58.181916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:58.182040 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:13:58.182186 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 01:13:58.182221 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 01:13:58.182283 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":112,"threads_started":1}
W20260812 01:13:58.182858 18461 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46202
Aug 12 01:13:58 dist-test-slave-rwrg krb5kdc[18157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 01:13:58 dist-test-slave-rwrg krb5kdc[18157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:13:58.207324 19153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:13:58.200352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46208 (local address 127.17.183.129:33705)
0812 01:13:58.200422 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 01:13:58.200424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:13:58.200564 (+ 140us) server_negotiation.cc:407] Connection header received
0812 01:13:58.200641 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:13:58.200642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:13:58.200652 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:13:58.200707 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:13:58.201263 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:58.201768 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:58.202462 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:58.202717 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:58.202772 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:13:58.205055 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:13:58.205057 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:13:58.205057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:13:58.205064 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:13:58.206450 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:58.206735 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:58.206736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:58.206736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:58.206784 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:58.206924 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:58.206925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:58.206925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:58.207002 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:13:58.207081 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 01:13:58.207153 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 01:13:58.207234 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 01:13:58.207924 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 18366
I20260812 01:13:58.228605 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 18637
I20260812 01:13:58.253033 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 18878
I20260812 01:13:58.263712 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 18178
2026-08-12T01:13:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2386 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:13:58 dist-test-slave-rwrg krb5kdc[19162](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:13:58 dist-test-slave-rwrg krb5kdc[19162](info): set up 2 sockets
Aug 12 01:13:58 dist-test-slave-rwrg krb5kdc[19162](info): commencing operation
krb5kdc: starting...
W20260812 01:13:59.574232 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:13:59 dist-test-slave-rwrg krb5kdc[19162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:13:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:13:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:13:59.694802 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:39751
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:39751
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:13:59.780452 19182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:13:59.780726 19182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:13:59.780773 19182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:13:59.781900 19182 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:13:59.781982 19182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:13:59.782007 19182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:13:59.782028 19182 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:13:59.782056 19182 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:13:59.783481 19182 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:39751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:39751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:13:59.783812 19182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:13:59.784060 19182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:13:59.788853 19194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:13:59.788923 19196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:13:59.788839 19193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:13:59.789561 19182 server_base.cc:1034] running on GCE node
I20260812 01:13:59.789948 19182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:13:59.792912 19182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:13:59.794121 19182 hybrid_clock.cc:648] HybridClock initialized: now 1786497239794073 us; error 51 us; skew 500 ppm
Aug 12 01:13:59 dist-test-slave-rwrg krb5kdc[19162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497239, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:13:59.798147 19182 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:13:59.800889 19182 webserver.cc:460] Webserver started at http://127.17.183.190:42509/ using document root <none> and password file <none>
I20260812 01:13:59.801147 19182 fs_manager.cc:359] Metadata directory not provided
I20260812 01:13:59.801215 19182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:13:59.801367 19182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:13:59.802482 19182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "bdb3831fbc9f4b1da94e5c5c98f0cf05"
format_stamp: "Formatted at 2026-08-12 01:13:59 on dist-test-slave-rwrg"
server_key: "df8465e189d84cad0512aa6c97efb999"
server_key_iv: "06c3a92aebde35fe7526a5f7e78a0ea1"
server_key_version: "encryptionkey@0"
I20260812 01:13:59.802886 19182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "bdb3831fbc9f4b1da94e5c5c98f0cf05"
format_stamp: "Formatted at 2026-08-12 01:13:59 on dist-test-slave-rwrg"
server_key: "df8465e189d84cad0512aa6c97efb999"
server_key_iv: "06c3a92aebde35fe7526a5f7e78a0ea1"
server_key_version: "encryptionkey@0"
I20260812 01:13:59.804359 19182 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:13:59.805341 19210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:13:59.805537 19182 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:13:59.805647 19182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "bdb3831fbc9f4b1da94e5c5c98f0cf05"
format_stamp: "Formatted at 2026-08-12 01:13:59 on dist-test-slave-rwrg"
server_key: "df8465e189d84cad0512aa6c97efb999"
server_key_iv: "06c3a92aebde35fe7526a5f7e78a0ea1"
server_key_version: "encryptionkey@0"
I20260812 01:13:59.805728 19182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:13:59.818511 19182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:13:59.820376 19182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:13:59.820604 19182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:13:59.824443 19182 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:39751
I20260812 01:13:59.824527 19327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:39751 every 8 connection(s)
I20260812 01:13:59.824889 19182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:13:59.825769 19328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:13:59.827989 19328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05: Bootstrap starting.
I20260812 01:13:59.828612 19328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05: Neither blocks nor log segments found. Creating new log.
I20260812 01:13:59.828861 19328 log.cc:824] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05: Log is configured to *not* fsync() on all Append() calls
I20260812 01:13:59.829564 19328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05: No bootstrap required, opened a new log
I20260812 01:13:59.831071 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 19182
I20260812 01:13:59.831168 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:13:59.831326 18142 external_mini_cluster.cc:1428] Setting key f5ae4fcba3f266872f388046bdc593b3
I20260812 01:13:59.831332 19328 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb3831fbc9f4b1da94e5c5c98f0cf05" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39751 } }
I20260812 01:13:59.831511 19328 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:13:59.831555 19328 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb3831fbc9f4b1da94e5c5c98f0cf05, State: Initialized, Role: FOLLOWER
I20260812 01:13:59.831691 19328 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb3831fbc9f4b1da94e5c5c98f0cf05" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39751 } }
I20260812 01:13:59.831794 19328 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:13:59.831828 19328 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:13:59.831874 19328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:13:59.832993 19328 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb3831fbc9f4b1da94e5c5c98f0cf05" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39751 } }
I20260812 01:13:59.833123 19328 leader_election.cc:302] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdb3831fbc9f4b1da94e5c5c98f0cf05; no voters:
I20260812 01:13:59.833280 19328 leader_election.cc:288] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:13:59.833353 19334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:13:59.833518 19334 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [term 1 LEADER]: Becoming Leader. State: Replica: bdb3831fbc9f4b1da94e5c5c98f0cf05, State: Running, Role: LEADER
I20260812 01:13:59.833523 19328 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:13:59.833631 19334 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb3831fbc9f4b1da94e5c5c98f0cf05" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39751 } }
I20260812 01:13:59.834033 19334 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdb3831fbc9f4b1da94e5c5c98f0cf05. Latest consensus state: current_term: 1 leader_uuid: "bdb3831fbc9f4b1da94e5c5c98f0cf05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb3831fbc9f4b1da94e5c5c98f0cf05" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39751 } } }
I20260812 01:13:59.834044 19336 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdb3831fbc9f4b1da94e5c5c98f0cf05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb3831fbc9f4b1da94e5c5c98f0cf05" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39751 } } }
I20260812 01:13:59.834129 19334 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [sys.catalog]: This master's current role is: LEADER
I20260812 01:13:59.834133 19336 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05 [sys.catalog]: This master's current role is: LEADER
I20260812 01:13:59.834362 19354 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:13:59.834936 19354 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:13:59.836586 19354 catalog_manager.cc:1347] Generated new cluster ID: 95ed997c4c984f91b68b9681fb3a0051
I20260812 01:13:59.836643 19354 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:13:59 dist-test-slave-rwrg krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:13:59.842070 19332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:13:59.831835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52990 (local address 127.17.183.190:39751)
0812 01:13:59.832034 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 01:13:59.832044 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:13:59.832089 (+ 45us) server_negotiation.cc:407] Connection header received
0812 01:13:59.832239 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:13:59.832246 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:13:59.832317 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:13:59.832511 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:13:59.833122 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:59.834623 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:59.835845 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:13:59.836366 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:13:59.836487 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:13:59.838801 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:13:59.838805 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:13:59.838805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:13:59.838823 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:13:59.840472 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:59.840875 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:59.840878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:59.840878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:59.840980 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:13:59.841198 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:13:59.841199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:13:59.841199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:13:59.841440 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:13:59.841604 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 01:13:59.841718 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 01:13:59.841862 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":94,"threads_started":1}
I20260812 01:13:59.842842 19354 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:13:59.843524 19354 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:13:59.852983 19354 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdb3831fbc9f4b1da94e5c5c98f0cf05: Generated new TSK 0
I20260812 01:13:59.853202 19354 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:13:59.891543 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39751
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:00.001947 19373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:00.002167 19373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:00.002194 19373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:00.003387 19373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:00.003433 19373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:00.003461 19373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:00.005228 19373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39751
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:00.005518 19373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:00.005788 19373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:00.011634 19382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:00.011631 19380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:00.011739 19373 server_base.cc:1034] running on GCE node
W20260812 01:14:00.011844 19379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:00.012154 19373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:00.012467 19373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:00.013669 19373 hybrid_clock.cc:648] HybridClock initialized: now 1786497240013644 us; error 34 us; skew 500 ppm
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[19162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497240, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:00.016690 19373 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:14:00.017154 19373 webserver.cc:460] Webserver started at http://127.17.183.129:35183/ using document root <none> and password file <none>
I20260812 01:14:00.017422 19373 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:00.017495 19373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:00.017663 19373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:00.018890 19373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "402b9dc214ab4e1c8d41676b26b16ef2"
format_stamp: "Formatted at 2026-08-12 01:14:00 on dist-test-slave-rwrg"
server_key: "6a3e38fff3d1126d7742c29a99d9df5b"
server_key_iv: "5a63f3d9f9500fa7c42da9dc6d92fdc6"
server_key_version: "encryptionkey@0"
I20260812 01:14:00.019279 19373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "402b9dc214ab4e1c8d41676b26b16ef2"
format_stamp: "Formatted at 2026-08-12 01:14:00 on dist-test-slave-rwrg"
server_key: "6a3e38fff3d1126d7742c29a99d9df5b"
server_key_iv: "5a63f3d9f9500fa7c42da9dc6d92fdc6"
server_key_version: "encryptionkey@0"
I20260812 01:14:00.020893 19373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:00.021674 19394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:00.021867 19373 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:00.021978 19373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "402b9dc214ab4e1c8d41676b26b16ef2"
format_stamp: "Formatted at 2026-08-12 01:14:00 on dist-test-slave-rwrg"
server_key: "6a3e38fff3d1126d7742c29a99d9df5b"
server_key_iv: "5a63f3d9f9500fa7c42da9dc6d92fdc6"
server_key_version: "encryptionkey@0"
I20260812 01:14:00.022064 19373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:00.039626 19373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:00.041829 19373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:00.042012 19373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:00.042382 19373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:00.042729 19373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:00.042788 19373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:00.042831 19373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:00.042877 19373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:00.051663 19373 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:36827
I20260812 01:14:00.051795 19620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:36827 every 8 connection(s)
I20260812 01:14:00.052142 19373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:14:00.057842 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 19373
I20260812 01:14:00.057926 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:00.058101 18142 external_mini_cluster.cc:1428] Setting key 401412d5d9fb38475d68e8b0b3f3f571
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497240, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:00.063045 19332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.053018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:53679 (local address 127.17.183.190:39751)
0812 01:14:00.053093 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.053095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.053313 (+ 218us) server_negotiation.cc:407] Connection header received
0812 01:14:00.054366 (+ 1053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.054367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.054381 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.054436 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:00.055128 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.055655 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.056836 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.057036 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.057095 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.059709 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:00.059711 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:00.059711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:00.059717 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:00.061530 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.061965 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.061967 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.061967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.062033 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.062336 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.062337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.062337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.062474 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:00.062532 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.062898 (+ 366us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.062977 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:14:00.063393 19624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.052961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:39751 (local address 127.17.183.129:53679)
0812 01:14:00.053174 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:00.053212 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:00.054264 (+ 1052us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:00.054493 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:00.054496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:00.054756 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:00.055035 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.055041 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.055747 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.055748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.056733 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.056736 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.057115 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.057116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.057224 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.057695 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:00.057703 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:00.059608 (+ 1905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:00.061664 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:00.061672 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:00.061673 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:00.061890 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:00.062152 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:00.062153 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:00.062154 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:00.062269 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:00.062564 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:00.062571 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:00.062751 (+ 180us) client_negotiation.cc:769] Sending connection context
0812 01:14:00.062872 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 01:14:00.063058 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":142,"threads_started":1}
I20260812 01:14:00.064070 19622 heartbeater.cc:347] Connected to a master server at 127.17.183.190:39751
I20260812 01:14:00.064189 19622 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:00.064409 19622 heartbeater.cc:511] Master 127.17.183.190:39751 requested a full tablet report, sending...
I20260812 01:14:00.065040 19250 ts_manager.cc:194] Registered new tserver with Master: 402b9dc214ab4e1c8d41676b26b16ef2 (127.17.183.129:36827)
I20260812 01:14:00.065667 19250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:53679
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:14:00.086812 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39751
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:00.181691 19629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:00.181895 19629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:00.181917 19629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:00.183162 19629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:00.183207 19629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:00.183264 19629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:00.184815 19629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39751
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:00.185066 19629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:00.185292 19629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:00.190800 19642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:00.190831 19643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:00.190820 19645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:00.191053 19629 server_base.cc:1034] running on GCE node
I20260812 01:14:00.191264 19629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:00.191504 19629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:00.192673 19629 hybrid_clock.cc:648] HybridClock initialized: now 1786497240192670 us; error 46 us; skew 500 ppm
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[19162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497240, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:00.195516 19629 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:14:00.195963 19629 webserver.cc:460] Webserver started at http://127.17.183.130:38997/ using document root <none> and password file <none>
I20260812 01:14:00.196164 19629 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:00.196218 19629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:00.196305 19629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:00.197412 19629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "94f551acd0a8459ea12ba73b20eba1e4"
format_stamp: "Formatted at 2026-08-12 01:14:00 on dist-test-slave-rwrg"
server_key: "e01ab2fd9c2419b53fd59c92a065be8e"
server_key_iv: "7004f9385cc8adf6962465b498817f3c"
server_key_version: "encryptionkey@0"
I20260812 01:14:00.197767 19629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "94f551acd0a8459ea12ba73b20eba1e4"
format_stamp: "Formatted at 2026-08-12 01:14:00 on dist-test-slave-rwrg"
server_key: "e01ab2fd9c2419b53fd59c92a065be8e"
server_key_iv: "7004f9385cc8adf6962465b498817f3c"
server_key_version: "encryptionkey@0"
I20260812 01:14:00.199059 19629 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:14:00.199801 19654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:00.199970 19629 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:00.200062 19629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "94f551acd0a8459ea12ba73b20eba1e4"
format_stamp: "Formatted at 2026-08-12 01:14:00 on dist-test-slave-rwrg"
server_key: "e01ab2fd9c2419b53fd59c92a065be8e"
server_key_iv: "7004f9385cc8adf6962465b498817f3c"
server_key_version: "encryptionkey@0"
I20260812 01:14:00.200129 19629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:00.216883 19629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:00.219076 19629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:00.219225 19629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:00.219590 19629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:00.219931 19629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:00.219987 19629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:00.220022 19629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:00.220067 19629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:00.229526 19629 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:40163
I20260812 01:14:00.229580 19852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:40163 every 8 connection(s)
I20260812 01:14:00.229914 19629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:00.232348 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 19629
I20260812 01:14:00.232429 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:00.232645 18142 external_mini_cluster.cc:1428] Setting key ca3098d7b60e339f15ffb6b88a4f94a4
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497240, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:00.241883 19856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.230712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:39751 (local address 127.17.183.130:47877)
0812 01:14:00.230962 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:00.231001 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:00.232073 (+ 1072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:00.232345 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:00.232348 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:00.232743 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:00.233293 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.233299 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.234111 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.234112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.235316 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.235320 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.235764 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.235766 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.235950 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.236568 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:00.236580 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:00.238262 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:00.240363 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:00.240370 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:00.240372 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:00.240672 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:00.240940 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:00.240941 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:00.240941 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:00.241046 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:00.241379 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:00.241385 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:00.241502 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 01:14:00.241592 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 01:14:00.241714 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":136,"threads_started":1}
I20260812 01:14:00.241920 19332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.230772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:47877 (local address 127.17.183.190:39751)
0812 01:14:00.230856 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.230859 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.231096 (+ 237us) server_negotiation.cc:407] Connection header received
0812 01:14:00.232184 (+ 1088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.232186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.232200 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.232273 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:00.233393 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.234017 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.235421 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.235673 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.235734 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.238352 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:00.238354 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:00.238355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:00.238380 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:00.240275 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.240756 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.240757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.240758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.240828 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.241126 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.241128 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.241128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.241301 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:00.241379 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.241666 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.241789 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 01:14:00.242386 19853 heartbeater.cc:347] Connected to a master server at 127.17.183.190:39751
I20260812 01:14:00.242498 19853 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:00.242677 19853 heartbeater.cc:511] Master 127.17.183.190:39751 requested a full tablet report, sending...
I20260812 01:14:00.243112 19250 ts_manager.cc:194] Registered new tserver with Master: 94f551acd0a8459ea12ba73b20eba1e4 (127.17.183.130:40163)
I20260812 01:14:00.243491 19250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:47877
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:14:00.261691 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39751
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:00.355264 19860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:00.355461 19860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:00.355484 19860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:00.356719 19860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:00.356760 19860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:00.356786 19860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:00.358337 19860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39751
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:00.358582 19860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:00.358837 19860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:00.364198 19879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:00.364300 19870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:00.364251 19871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:00.364621 19860 server_base.cc:1034] running on GCE node
I20260812 01:14:00.364856 19860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:00.365090 19860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:00.366261 19860 hybrid_clock.cc:648] HybridClock initialized: now 1786497240366260 us; error 54 us; skew 500 ppm
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[19162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497240, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:00.369102 19860 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:14:00.369688 19860 webserver.cc:460] Webserver started at http://127.17.183.131:39795/ using document root <none> and password file <none>
I20260812 01:14:00.369985 19860 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:00.370048 19860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:00.370184 19860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:00.371219 19860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "67a32738074643d9aa24f96df571201f"
format_stamp: "Formatted at 2026-08-12 01:14:00 on dist-test-slave-rwrg"
server_key: "c61bde8adf4331f60b99d417f9e8001d"
server_key_iv: "2362e2bbedd03f5b5036b36f792f5ec9"
server_key_version: "encryptionkey@0"
I20260812 01:14:00.371588 19860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "67a32738074643d9aa24f96df571201f"
format_stamp: "Formatted at 2026-08-12 01:14:00 on dist-test-slave-rwrg"
server_key: "c61bde8adf4331f60b99d417f9e8001d"
server_key_iv: "2362e2bbedd03f5b5036b36f792f5ec9"
server_key_version: "encryptionkey@0"
I20260812 01:14:00.373067 19860 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:00.373790 19890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:00.373965 19860 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:00.374084 19860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "67a32738074643d9aa24f96df571201f"
format_stamp: "Formatted at 2026-08-12 01:14:00 on dist-test-slave-rwrg"
server_key: "c61bde8adf4331f60b99d417f9e8001d"
server_key_iv: "2362e2bbedd03f5b5036b36f792f5ec9"
server_key_version: "encryptionkey@0"
I20260812 01:14:00.374157 19860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:00.390116 19860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:00.392413 19860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:00.392613 19860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:00.392863 19860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:00.393211 19860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:00.393267 19860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:00.393311 19860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:00.393337 19860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:00.402544 19860 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:39427
I20260812 01:14:00.402635 20111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:39427 every 8 connection(s)
I20260812 01:14:00.402992 19860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:00.407263 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 19860
I20260812 01:14:00.407343 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:00.407496 18142 external_mini_cluster.cc:1428] Setting key ec31f4a0f5691bdc21b3fe3dd3c22a37
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497240, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:00.413496 19332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.403867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:59621 (local address 127.17.183.190:39751)
0812 01:14:00.403913 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.403915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.404296 (+ 381us) server_negotiation.cc:407] Connection header received
0812 01:14:00.405607 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.405608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.405620 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.405675 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:00.406405 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.406899 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.408591 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.408776 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.408826 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.411189 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:00.411191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:00.411191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:00.411197 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:00.412375 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.412761 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.412762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.412762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.412814 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.413017 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.413018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.413018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.413118 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:00.413163 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.413374 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.413431 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:14:00.413797 20118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.403826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:39751 (local address 127.17.183.131:59621)
0812 01:14:00.404175 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:00.404215 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:00.405501 (+ 1286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:00.405734 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:00.405744 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:00.406046 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:00.406330 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.406335 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.406982 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.406982 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.408518 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.408521 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.408847 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.408848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.409002 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.409574 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:00.409583 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:00.411107 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:00.412445 (+ 1338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:00.412452 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:00.412454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:00.412695 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:00.412876 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:00.412876 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:00.412876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:00.412976 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:00.413169 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:00.413173 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:00.413284 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 01:14:00.413358 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 01:14:00.413473 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":192,"threads_started":1}
I20260812 01:14:00.414299 20113 heartbeater.cc:347] Connected to a master server at 127.17.183.190:39751
I20260812 01:14:00.414382 20113 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:00.414525 20113 heartbeater.cc:511] Master 127.17.183.190:39751 requested a full tablet report, sending...
I20260812 01:14:00.414853 19250 ts_manager.cc:194] Registered new tserver with Master: 67a32738074643d9aa24f96df571201f (127.17.183.131:39427)
I20260812 01:14:00.415187 19250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:59621
I20260812 01:14:00.419085 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:14:00.427032 19332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.420800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52998 (local address 127.17.183.190:39751)
0812 01:14:00.420853 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.420855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.421081 (+ 226us) server_negotiation.cc:407] Connection header received
0812 01:14:00.421130 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.421131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.421140 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.421177 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:00.421848 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.422287 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.422926 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.423091 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.423138 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.424448 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:00.424449 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:00.424450 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:00.424457 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:00.426113 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.426410 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.426411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.426411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.426461 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.426608 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.426609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.426609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.426732 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:00.426809 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.426893 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.426948 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 01:14:00.429180 19250 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52998:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:00.430940 19250 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:00.438895 20143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.433766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:39427 (local address 127.0.0.1:39722)
0812 01:14:00.434435 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:00.434448 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:00.434496 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:00.435134 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:00.435135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:00.435137 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:00.435193 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.435194 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.436297 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.436299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.437747 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.437750 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.438571 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.438572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.438654 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.438668 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 01:14:00.438763 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 01:14:00.438817 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"mutex_wait_us":62,"thread_start_us":172,"threads_started":1}
I20260812 01:14:00.438937 20146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.434134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39722 (local address 127.17.183.131:39427)
0812 01:14:00.434769 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.434773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.434783 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:00.434849 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.434851 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.434866 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.434954 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:00.435295 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.436086 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.437846 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.438474 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.438574 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.438636 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.438782 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.438821 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":156,"threads_started":1}
I20260812 01:14:00.439410 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.433493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:36827 (local address 127.0.0.1:55540)
0812 01:14:00.434043 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:00.434088 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:00.434161 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:00.434762 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:00.434765 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:00.434768 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:00.434850 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.434852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.436845 (+ 1993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.436846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.437627 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.437629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.438818 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.438819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.438924 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.438929 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:14:00.439284 (+ 355us) client_negotiation.cc:240] Negotiation successful
0812 01:14:00.439334 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"mutex_wait_us":3,"thread_start_us":65,"threads_started":1}
I20260812 01:14:00.439565 20145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.433901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37554 (local address 127.17.183.130:40163)
0812 01:14:00.434338 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.434343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.434616 (+ 273us) server_negotiation.cc:407] Connection header received
0812 01:14:00.434697 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.434700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.434717 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.434797 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:00.434988 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.436378 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.437964 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.439095 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.439156 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.439209 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.439392 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.439442 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":166,"threads_started":1}
I20260812 01:14:00.439484 20140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.433520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:40163 (local address 127.0.0.1:37554)
0812 01:14:00.434451 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:00.434461 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:00.434511 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:00.434802 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:00.434803 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:00.434806 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:00.434866 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.434869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.436764 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.436764 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.437883 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.437885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.439237 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.439238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.439300 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.439303 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:00.439355 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 01:14:00.439384 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":854,"mutex_wait_us":19,"thread_start_us":192,"threads_started":1}
I20260812 01:14:00.439913 20142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.433692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55540 (local address 127.17.183.129:36827)
0812 01:14:00.434148 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.434154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.434168 (+ 14us) server_negotiation.cc:407] Connection header received
0812 01:14:00.434376 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.434379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.434398 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.434483 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:00.434983 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.436379 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.437774 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.438609 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.438700 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.438755 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.439710 (+ 955us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.439762 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":195,"threads_started":1}
I20260812 01:14:00.440017 19990 tablet_service.cc:1467] Processing CreateTablet for tablet 4615a6720c8547ef8bc2604cb243afef (DEFAULT_TABLE table=test-table [id=258480c5852945a995b24a4c21b30dc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:00.440433 19990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4615a6720c8547ef8bc2604cb243afef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:00.440784 19751 tablet_service.cc:1467] Processing CreateTablet for tablet 4615a6720c8547ef8bc2604cb243afef (DEFAULT_TABLE table=test-table [id=258480c5852945a995b24a4c21b30dc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:00.441038 19493 tablet_service.cc:1467] Processing CreateTablet for tablet 4615a6720c8547ef8bc2604cb243afef (DEFAULT_TABLE table=test-table [id=258480c5852945a995b24a4c21b30dc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:00.441162 19751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4615a6720c8547ef8bc2604cb243afef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:00.441388 19493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4615a6720c8547ef8bc2604cb243afef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:00.445032 20149 tablet_bootstrap.cc:492] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f: Bootstrap starting.
I20260812 01:14:00.446345 20149 tablet_bootstrap.cc:654] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:00.446991 20154 tablet_bootstrap.cc:492] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2: Bootstrap starting.
I20260812 01:14:00.447247 20152 tablet_bootstrap.cc:492] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4: Bootstrap starting.
I20260812 01:14:00.447772 20149 log.cc:824] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:00.447996 20152 tablet_bootstrap.cc:654] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:00.448670 20154 tablet_bootstrap.cc:654] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:00.448640 20152 log.cc:824] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:00.449301 20154 log.cc:824] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:00.449364 20152 tablet_bootstrap.cc:492] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4: No bootstrap required, opened a new log
I20260812 01:14:00.449381 20149 tablet_bootstrap.cc:492] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f: No bootstrap required, opened a new log
I20260812 01:14:00.449453 20152 ts_tablet_manager.cc:1397] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:00.449457 20149 ts_tablet_manager.cc:1397] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 01:14:00.450169 20154 tablet_bootstrap.cc:492] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2: No bootstrap required, opened a new log
I20260812 01:14:00.450254 20154 ts_tablet_manager.cc:1397] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:14:00.451084 20152 raft_consensus.cc:348] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402b9dc214ab4e1c8d41676b26b16ef2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36827 } } peers { permanent_uuid: "94f551acd0a8459ea12ba73b20eba1e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40163 } } peers { permanent_uuid: "67a32738074643d9aa24f96df571201f" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 39427 } }
I20260812 01:14:00.451243 20152 raft_consensus.cc:374] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:00.451288 20152 raft_consensus.cc:729] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f551acd0a8459ea12ba73b20eba1e4, State: Initialized, Role: FOLLOWER
I20260812 01:14:00.451404 20152 consensus_queue.cc:260] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402b9dc214ab4e1c8d41676b26b16ef2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36827 } } peers { permanent_uuid: "94f551acd0a8459ea12ba73b20eba1e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40163 } } peers { permanent_uuid: "67a32738074643d9aa24f96df571201f" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 39427 } }
I20260812 01:14:00.451720 20152 ts_tablet_manager.cc:1428] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:00.451730 19853 heartbeater.cc:503] Master 127.17.183.190:39751 was elected leader, sending a full tablet report...
I20260812 01:14:00.451812 20149 raft_consensus.cc:348] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402b9dc214ab4e1c8d41676b26b16ef2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36827 } } peers { permanent_uuid: "94f551acd0a8459ea12ba73b20eba1e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40163 } } peers { permanent_uuid: "67a32738074643d9aa24f96df571201f" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 39427 } }
I20260812 01:14:00.451993 20149 raft_consensus.cc:374] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:00.452052 20149 raft_consensus.cc:729] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67a32738074643d9aa24f96df571201f, State: Initialized, Role: FOLLOWER
I20260812 01:14:00.452181 20149 consensus_queue.cc:260] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402b9dc214ab4e1c8d41676b26b16ef2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36827 } } peers { permanent_uuid: "94f551acd0a8459ea12ba73b20eba1e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40163 } } peers { permanent_uuid: "67a32738074643d9aa24f96df571201f" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 39427 } }
I20260812 01:14:00.452360 20154 raft_consensus.cc:348] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402b9dc214ab4e1c8d41676b26b16ef2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36827 } } peers { permanent_uuid: "94f551acd0a8459ea12ba73b20eba1e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40163 } } peers { permanent_uuid: "67a32738074643d9aa24f96df571201f" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 39427 } }
I20260812 01:14:00.452508 20113 heartbeater.cc:503] Master 127.17.183.190:39751 was elected leader, sending a full tablet report...
I20260812 01:14:00.452576 20154 raft_consensus.cc:374] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:00.452613 20154 raft_consensus.cc:729] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402b9dc214ab4e1c8d41676b26b16ef2, State: Initialized, Role: FOLLOWER
I20260812 01:14:00.452481 20149 ts_tablet_manager.cc:1428] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:14:00.452775 20154 consensus_queue.cc:260] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402b9dc214ab4e1c8d41676b26b16ef2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36827 } } peers { permanent_uuid: "94f551acd0a8459ea12ba73b20eba1e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40163 } } peers { permanent_uuid: "67a32738074643d9aa24f96df571201f" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 39427 } }
I20260812 01:14:00.453058 20154 ts_tablet_manager.cc:1428] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:14:00.453099 19622 heartbeater.cc:503] Master 127.17.183.190:39751 was elected leader, sending a full tablet report...
W20260812 01:14:00.480593 19854 tablet.cc:2369] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:14:00.553113 19623 tablet.cc:2369] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:14:00.653820 20116 tablet.cc:2369] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:14:00.713521 20158 raft_consensus.cc:482] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:00.713661 20158 raft_consensus.cc:504] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402b9dc214ab4e1c8d41676b26b16ef2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36827 } } peers { permanent_uuid: "94f551acd0a8459ea12ba73b20eba1e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40163 } } peers { permanent_uuid: "67a32738074643d9aa24f96df571201f" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 39427 } }
I20260812 01:14:00.714139 20158 leader_election.cc:288] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402b9dc214ab4e1c8d41676b26b16ef2 (127.17.183.129:36827), 67a32738074643d9aa24f96df571201f (127.17.183.131:39427)
I20260812 01:14:00.717229 20146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.714575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:58925 (local address 127.17.183.131:39427)
0812 01:14:00.714619 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.714621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.714666 (+ 45us) server_negotiation.cc:407] Connection header received
0812 01:14:00.714727 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.714728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.714739 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.714805 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:00.715000 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.715491 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.716447 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.716863 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.716948 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.716959 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.717108 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.717159 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 01:14:00.717229 20163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.714481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:39427 (local address 127.17.183.130:58925)
0812 01:14:00.714612 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:00.714621 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:00.714671 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:00.714839 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:00.714840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:00.714842 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:00.714922 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.714924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.715572 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.715573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.716311 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.716312 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.716945 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.716946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.717027 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.717032 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:14:00.717080 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 01:14:00.717114 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":65,"threads_started":1}
I20260812 01:14:00.717310 20142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.714446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:37867 (local address 127.17.183.129:36827)
0812 01:14:00.714496 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.714499 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.714511 (+ 12us) server_negotiation.cc:407] Connection header received
0812 01:14:00.714578 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.714579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.714589 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.714651 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:00.714843 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.715380 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.716402 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.716867 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.716956 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.716965 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.717189 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.717230 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 01:14:00.717347 19856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.714343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:36827 (local address 127.17.183.130:37867)
0812 01:14:00.714419 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:00.714435 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:00.714510 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:00.714667 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:00.714669 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:00.714672 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:00.714755 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.714757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.715467 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.715468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.716282 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:00.716285 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.716975 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.716977 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:00.717098 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.717102 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:00.717161 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 01:14:00.717198 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 01:14:00.717722 19533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4615a6720c8547ef8bc2604cb243afef" candidate_uuid: "94f551acd0a8459ea12ba73b20eba1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402b9dc214ab4e1c8d41676b26b16ef2" is_pre_election: true
I20260812 01:14:00.717746 20018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4615a6720c8547ef8bc2604cb243afef" candidate_uuid: "94f551acd0a8459ea12ba73b20eba1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67a32738074643d9aa24f96df571201f" is_pre_election: true
I20260812 01:14:00.717890 20018 raft_consensus.cc:2454] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94f551acd0a8459ea12ba73b20eba1e4 in term 0.
I20260812 01:14:00.717903 19533 raft_consensus.cc:2454] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94f551acd0a8459ea12ba73b20eba1e4 in term 0.
I20260812 01:14:00.718153 19657 leader_election.cc:302] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67a32738074643d9aa24f96df571201f, 94f551acd0a8459ea12ba73b20eba1e4; no voters:
I20260812 01:14:00.718300 20158 raft_consensus.cc:2781] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:00.718384 20158 raft_consensus.cc:482] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:00.718415 20158 raft_consensus.cc:3037] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:00.719359 20158 raft_consensus.cc:504] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402b9dc214ab4e1c8d41676b26b16ef2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36827 } } peers { permanent_uuid: "94f551acd0a8459ea12ba73b20eba1e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40163 } } peers { permanent_uuid: "67a32738074643d9aa24f96df571201f" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 39427 } }
I20260812 01:14:00.719511 20158 leader_election.cc:288] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [CANDIDATE]: Term 1 election: Requested vote from peers 402b9dc214ab4e1c8d41676b26b16ef2 (127.17.183.129:36827), 67a32738074643d9aa24f96df571201f (127.17.183.131:39427)
I20260812 01:14:00.719693 19533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4615a6720c8547ef8bc2604cb243afef" candidate_uuid: "94f551acd0a8459ea12ba73b20eba1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402b9dc214ab4e1c8d41676b26b16ef2"
I20260812 01:14:00.719779 19533 raft_consensus.cc:3037] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:00.719743 20018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4615a6720c8547ef8bc2604cb243afef" candidate_uuid: "94f551acd0a8459ea12ba73b20eba1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67a32738074643d9aa24f96df571201f"
I20260812 01:14:00.719844 20018 raft_consensus.cc:3037] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:00.720595 19533 raft_consensus.cc:2454] T 4615a6720c8547ef8bc2604cb243afef P 402b9dc214ab4e1c8d41676b26b16ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f551acd0a8459ea12ba73b20eba1e4 in term 1.
I20260812 01:14:00.720762 19657 leader_election.cc:302] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402b9dc214ab4e1c8d41676b26b16ef2, 94f551acd0a8459ea12ba73b20eba1e4; no voters:
I20260812 01:14:00.720852 20018 raft_consensus.cc:2454] T 4615a6720c8547ef8bc2604cb243afef P 67a32738074643d9aa24f96df571201f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f551acd0a8459ea12ba73b20eba1e4 in term 1.
I20260812 01:14:00.720877 20158 raft_consensus.cc:2781] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:00.721024 20158 raft_consensus.cc:686] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [term 1 LEADER]: Becoming Leader. State: Replica: 94f551acd0a8459ea12ba73b20eba1e4, State: Running, Role: LEADER
I20260812 01:14:00.721144 20158 consensus_queue.cc:237] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402b9dc214ab4e1c8d41676b26b16ef2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36827 } } peers { permanent_uuid: "94f551acd0a8459ea12ba73b20eba1e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40163 } } peers { permanent_uuid: "67a32738074643d9aa24f96df571201f" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 39427 } }
I20260812 01:14:00.722012 19250 catalog_manager.cc:5495] T 4615a6720c8547ef8bc2604cb243afef P 94f551acd0a8459ea12ba73b20eba1e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94f551acd0a8459ea12ba73b20eba1e4 (127.17.183.130). New cstate: current_term: 1 leader_uuid: "94f551acd0a8459ea12ba73b20eba1e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402b9dc214ab4e1c8d41676b26b16ef2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94f551acd0a8459ea12ba73b20eba1e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67a32738074643d9aa24f96df571201f" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 39427 } health_report { overall_health: UNKNOWN } } }
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:14:00.797422 20142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.789873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55548 (local address 127.17.183.129:36827)
0812 01:14:00.789934 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.789936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.790051 (+ 115us) server_negotiation.cc:407] Connection header received
0812 01:14:00.790076 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.790077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.790086 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.790127 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:00.790752 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.791237 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.791950 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.792144 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.792201 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.794636 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:00.794648 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:00.794649 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:00.794656 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:00.796228 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.796615 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.796622 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.796622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.796697 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.796888 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.796888 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.796889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.797067 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:00.797176 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.797235 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.797303 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[19162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497240, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497240, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:14:00.823483 20142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.815871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55558 (local address 127.17.183.129:36827)
0812 01:14:00.815953 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.815956 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.816049 (+ 93us) server_negotiation.cc:407] Connection header received
0812 01:14:00.816146 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.816147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.816158 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.816229 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:00.816911 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.817410 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.818153 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.818362 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.818443 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.820789 (+ 2346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:00.820790 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:00.820791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:00.820798 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:00.822298 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.822689 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.822690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.822690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.822751 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.822932 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.822933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.822934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.823055 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:00.823133 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.823344 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.823414 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[19162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:14:00.847244 20142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:00.840832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55570 (local address 127.17.183.129:36827)
0812 01:14:00.840885 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:00.840887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:00.840974 (+ 87us) server_negotiation.cc:407] Connection header received
0812 01:14:00.841032 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:00.841032 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:00.841041 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:00.841090 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:00.841634 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.842090 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.842805 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:00.842981 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:00.843034 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:00.845162 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:00.845163 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:00.845164 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:00.845170 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:00.846341 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.846639 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.846640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.846640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.846688 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:00.846854 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:00.846854 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:00.846855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:00.846940 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:00.847012 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:00.847102 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 01:14:00.847157 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 01:14:00.847790 19448 tablet_service.cc:2908] Rejecting scan request for tablet 4615a6720c8547ef8bc2604cb243afef: Uninitialized: clean time has not yet been initialized
I20260812 01:14:00.848680 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 19373
I20260812 01:14:00.869131 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 19629
I20260812 01:14:00.884666 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 19860
I20260812 01:14:00.893193 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 19182
2026-08-12T01:14:00Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2627 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[20190](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[20190](info): set up 2 sockets
Aug 12 01:14:00 dist-test-slave-rwrg krb5kdc[20190](info): commencing operation
krb5kdc: starting...
W20260812 01:14:02.211967 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:02 dist-test-slave-rwrg krb5kdc[20190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:14:02.335182 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44925
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:44925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:02.416599 20209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:02.416951 20209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:02.417008 20209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:02.418509 20209 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:02.418552 20209 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 01:14:02.418567 20209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:02.418587 20209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:02.418601 20209 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:02.418622 20209 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:02.420157 20209 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:44925
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:02.420415 20209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:02.420684 20209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:02.425362 20228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:02.425380 20224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:02.425367 20225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:02.425680 20209 server_base.cc:1034] running on GCE node
I20260812 01:14:02.425930 20209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:02.426196 20209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:02.427337 20209 hybrid_clock.cc:648] HybridClock initialized: now 1786497242427321 us; error 32 us; skew 500 ppm
Aug 12 01:14:02 dist-test-slave-rwrg krb5kdc[20190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497242, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:02.429890 20209 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:14:02.430330 20209 webserver.cc:460] Webserver started at http://127.17.183.190:46757/ using document root <none> and password file <none>
I20260812 01:14:02.430584 20209 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:02.430629 20209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:02.430787 20209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:02.431823 20209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "a750b2ed32674a8a8914a84ec0739307"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "2097a9886a18c4e19f7e4539d08072a9"
server_key_iv: "f282f6e44fcd93bdcc052c6008cc0a1e"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.432193 20209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "a750b2ed32674a8a8914a84ec0739307"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "2097a9886a18c4e19f7e4539d08072a9"
server_key_iv: "f282f6e44fcd93bdcc052c6008cc0a1e"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.433637 20209 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:02.434399 20241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:02.434578 20209 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:02.434681 20209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "a750b2ed32674a8a8914a84ec0739307"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "2097a9886a18c4e19f7e4539d08072a9"
server_key_iv: "f282f6e44fcd93bdcc052c6008cc0a1e"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.434762 20209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:02.449005 20209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:02.450838 20209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:02.450990 20209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:02.456108 20209 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:44925
I20260812 01:14:02.456158 20348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:44925 every 8 connection(s)
I20260812 01:14:02.456601 20209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:02.457265 20349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:02.459530 20349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307: Bootstrap starting.
I20260812 01:14:02.460137 20349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:02.460484 20349 log.cc:824] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:02.460950 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 20209
I20260812 01:14:02.461057 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:02.461233 18142 external_mini_cluster.cc:1428] Setting key 0abd83a24032eecbb5546f13faaa5883
I20260812 01:14:02.461429 20349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307: No bootstrap required, opened a new log
I20260812 01:14:02.463762 20349 raft_consensus.cc:348] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a750b2ed32674a8a8914a84ec0739307" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44925 } }
I20260812 01:14:02.463922 20349 raft_consensus.cc:374] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:02.463967 20349 raft_consensus.cc:729] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a750b2ed32674a8a8914a84ec0739307, State: Initialized, Role: FOLLOWER
I20260812 01:14:02.464092 20349 consensus_queue.cc:260] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a750b2ed32674a8a8914a84ec0739307" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44925 } }
I20260812 01:14:02.464187 20349 raft_consensus.cc:388] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:02.464233 20349 raft_consensus.cc:482] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:02.464282 20349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:02.464939 20349 raft_consensus.cc:504] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a750b2ed32674a8a8914a84ec0739307" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44925 } }
I20260812 01:14:02.465057 20349 leader_election.cc:302] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a750b2ed32674a8a8914a84ec0739307; no voters:
I20260812 01:14:02.465261 20349 leader_election.cc:288] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:02.465319 20357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:02.465437 20357 raft_consensus.cc:686] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [term 1 LEADER]: Becoming Leader. State: Replica: a750b2ed32674a8a8914a84ec0739307, State: Running, Role: LEADER
I20260812 01:14:02.465526 20349 sys_catalog.cc:564] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:02.465517 20357 consensus_queue.cc:237] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a750b2ed32674a8a8914a84ec0739307" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44925 } }
I20260812 01:14:02.465931 20358 sys_catalog.cc:455] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a750b2ed32674a8a8914a84ec0739307" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a750b2ed32674a8a8914a84ec0739307" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44925 } } }
I20260812 01:14:02.466051 20358 sys_catalog.cc:458] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:02.465931 20359 sys_catalog.cc:455] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a750b2ed32674a8a8914a84ec0739307. Latest consensus state: current_term: 1 leader_uuid: "a750b2ed32674a8a8914a84ec0739307" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a750b2ed32674a8a8914a84ec0739307" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44925 } } }
I20260812 01:14:02.467135 20359 sys_catalog.cc:458] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:02.468154 20372 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:02.468748 20372 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 01:14:02 dist-test-slave-rwrg krb5kdc[20190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:02.470808 20372 catalog_manager.cc:1347] Generated new cluster ID: f5ce722464684ebc8489dc3401be2aa8
I20260812 01:14:02.470853 20372 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:02.474658 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.461781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44742 (local address 127.17.183.190:44925)
0812 01:14:02.461977 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:02.461986 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:02.462021 (+ 35us) server_negotiation.cc:407] Connection header received
0812 01:14:02.463739 (+ 1718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:02.463747 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:02.463799 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:02.463953 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:02.464768 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.465927 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.467041 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.467843 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.467965 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.470794 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:02.470798 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:02.470798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:02.470812 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:02.472875 (+ 2063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.473295 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.473298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.473298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.473453 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.473665 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.473666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.473666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.473986 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:02.474176 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:02.474247 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 01:14:02.474387 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":82,"threads_started":1}
I20260812 01:14:02.480124 20372 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:02.480695 20372 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:02.485572 20372 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307: Generated new TSK 0
I20260812 01:14:02.485749 20372 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:14:02.514775 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:44925
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:02.598315 20398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:02.598515 20398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:02.598538 20398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:02.599757 20398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:02.599828 20398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:02.599874 20398 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:14:02.599910 20398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:02.601398 20398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.183.190:44925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:02.601636 20398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:02.601871 20398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:02.606913 20421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:02.606921 20414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:02.606976 20412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:02.607159 20398 server_base.cc:1034] running on GCE node
I20260812 01:14:02.607379 20398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:02.607575 20398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:02.608716 20398 hybrid_clock.cc:648] HybridClock initialized: now 1786497242608703 us; error 30 us; skew 500 ppm
Aug 12 01:14:02 dist-test-slave-rwrg krb5kdc[20190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497242, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:02.615916 20398 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:14:02.616369 20398 webserver.cc:460] Webserver started at http://127.17.183.129:41785/ using document root <none> and password file <none>
I20260812 01:14:02.616618 20398 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:02.616665 20398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:02.616753 20398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:02.617753 20398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "ecbc5301e5cb46978753f6b57a71d4ac"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "09cddf90495416e54118a18910e354fa"
server_key_iv: "c74fccef6cdc48e340b52d3d98fb2876"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.618054 20398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "ecbc5301e5cb46978753f6b57a71d4ac"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "09cddf90495416e54118a18910e354fa"
server_key_iv: "c74fccef6cdc48e340b52d3d98fb2876"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.619416 20398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:02.620177 20437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:02.620364 20398 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:02.620456 20398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "ecbc5301e5cb46978753f6b57a71d4ac"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "09cddf90495416e54118a18910e354fa"
server_key_iv: "c74fccef6cdc48e340b52d3d98fb2876"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.620558 20398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:02.635643 20398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:02.637749 20398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:02.637912 20398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:02.638454 20398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:02.638527 20398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:02.638573 20398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:02.638597 20398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:02.645423 20398 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:36411
I20260812 01:14:02.645505 20652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:36411 every 8 connection(s)
I20260812 01:14:02.645777 20398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
Aug 12 01:14:02 dist-test-slave-rwrg krb5kdc[20190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497242, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:02.648763 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.639041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:34929 (local address 127.17.183.190:44925)
0812 01:14:02.639110 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:02.639112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:02.639411 (+ 299us) server_negotiation.cc:407] Connection header received
0812 01:14:02.639915 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:02.639916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:02.639934 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:02.640012 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:02.640922 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.641763 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.643331 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.643685 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.643779 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.646391 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:02.646392 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:02.646392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:02.646400 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:02.647563 (+ 1163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.647947 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.647948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.647948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.648000 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.648179 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.648179 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.648180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.648279 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:02.648330 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:02.648628 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 01:14:02.648700 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 01:14:02.648931 20452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.639143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44925 (local address 127.17.183.129:34929)
0812 01:14:02.639304 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:02.639338 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:02.639809 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:02.640137 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:02.640141 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:02.640533 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:02.640821 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.640829 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.641867 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.641868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.643227 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.643231 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.643785 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.643786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.643910 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.644535 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:02.644544 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:02.646295 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:02.647664 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.647671 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.647672 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.647881 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.648040 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.648041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.648041 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.648129 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.648339 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:02.648344 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:02.648449 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 01:14:02.648593 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 01:14:02.648713 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260812 01:14:02.649541 20653 heartbeater.cc:347] Connected to a master server at 127.17.183.190:44925
I20260812 01:14:02.649677 20653 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:02.649856 20653 heartbeater.cc:511] Master 127.17.183.190:44925 requested a full tablet report, sending...
I20260812 01:14:02.650323 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 20398
I20260812 01:14:02.650439 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:02.650434 20267 ts_manager.cc:194] Registered new tserver with Master: ecbc5301e5cb46978753f6b57a71d4ac (127.17.183.129:36411)
I20260812 01:14:02.650655 18142 external_mini_cluster.cc:1428] Setting key 23e7f5ba637e3ccf6b328ba33ac97ed0
I20260812 01:14:02.651268 20267 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:34929
I20260812 01:14:02.657791 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.650688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:34401 (local address 127.17.183.190:44925)
0812 01:14:02.651493 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:02.651495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:02.651505 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:02.651525 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:02.651526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:02.651536 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:02.651604 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:02.652463 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.653207 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.653939 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.654146 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.654229 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.655226 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:02.655227 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:02.655227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:02.655234 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:02.656656 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.657075 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.657076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.657076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.657137 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.657351 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.657351 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.657352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.657444 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:02.657492 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:02.657670 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 01:14:02.657732 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":784}
I20260812 01:14:02.657939 20662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.650678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44925 (local address 127.17.183.129:34401)
0812 01:14:02.650876 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:02.650888 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:02.650941 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:02.651640 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:02.651641 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:02.652329 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:02.652376 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.652379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.653318 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.653319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.653837 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.653839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.654232 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.654233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.654316 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.654719 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:02.654725 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:02.655137 (+ 412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:02.656735 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.656736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.656736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.656991 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.657204 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.657205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.657206 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.657283 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.657509 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:02.657510 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:02.657565 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 01:14:02.657645 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 01:14:02.657762 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":126,"threads_started":1}
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:14:02.679198 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:44925
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:02.763017 20668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:02.763217 20668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:02.763239 20668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:02.764367 20668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:02.764407 20668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:02.764426 20668 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:14:02.764443 20668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:02.765858 20668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.183.190:44925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:02.766034 20668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:02.766219 20668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:02.771373 20683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:02.771410 20675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:02.771554 20668 server_base.cc:1034] running on GCE node
W20260812 01:14:02.771616 20679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:02.771829 20668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:02.772017 20668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:02.773152 20668 hybrid_clock.cc:648] HybridClock initialized: now 1786497242773137 us; error 28 us; skew 500 ppm
Aug 12 01:14:02 dist-test-slave-rwrg krb5kdc[20190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497242, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:02.775655 20668 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:14:02.776134 20668 webserver.cc:460] Webserver started at http://127.17.183.130:34121/ using document root <none> and password file <none>
I20260812 01:14:02.776352 20668 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:02.776419 20668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:02.776592 20668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:02.777684 20668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "85b6e99ac5024d0fa2e2a02d05923829"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "e33d4561acbeae126ebc5cc98f26b63d"
server_key_iv: "2b2062306951805e020bc6c5fade0836"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.778045 20668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "85b6e99ac5024d0fa2e2a02d05923829"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "e33d4561acbeae126ebc5cc98f26b63d"
server_key_iv: "2b2062306951805e020bc6c5fade0836"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.779402 20668 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:02.780114 20698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:02.780297 20668 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:02.780397 20668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "85b6e99ac5024d0fa2e2a02d05923829"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "e33d4561acbeae126ebc5cc98f26b63d"
server_key_iv: "2b2062306951805e020bc6c5fade0836"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.780476 20668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:02.803776 20668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:02.805774 20668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:02.805939 20668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:02.806504 20668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:02.806581 20668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:02.806615 20668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:02.806658 20668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:14:02 dist-test-slave-rwrg krb5kdc[20190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497242, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:02.814437 20668 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:34241
I20260812 01:14:02.814544 20901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:34241 every 8 connection(s)
I20260812 01:14:02.814873 20668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:02.817229 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.806981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:50423 (local address 127.17.183.190:44925)
0812 01:14:02.807065 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:02.807067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:02.807338 (+ 271us) server_negotiation.cc:407] Connection header received
0812 01:14:02.808084 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:02.808085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:02.808099 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:02.808159 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:02.809166 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.809716 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.811395 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.811597 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.811682 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.814235 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:02.814245 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:02.814245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:02.814254 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:02.815788 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.816198 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.816200 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.816200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.816275 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.816576 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.816577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.816577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.816700 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:02.816784 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:02.817058 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 01:14:02.817142 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 01:14:02.817389 20711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.806954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44925 (local address 127.17.183.130:50423)
0812 01:14:02.807177 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:02.807232 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:02.807966 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:02.808249 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:02.808254 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:02.808719 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:02.809041 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.809049 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.809823 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.809824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.811295 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.811299 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.811713 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.811715 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.811861 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.812389 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:02.812398 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:02.814123 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:02.815891 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.815899 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.815901 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.816119 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.816350 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.816351 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.816352 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.816464 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.816775 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:02.816783 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:02.816920 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 01:14:02.817019 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 01:14:02.817172 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":111,"threads_started":1}
I20260812 01:14:02.817953 20902 heartbeater.cc:347] Connected to a master server at 127.17.183.190:44925
I20260812 01:14:02.818060 20902 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:02.818236 20902 heartbeater.cc:511] Master 127.17.183.190:44925 requested a full tablet report, sending...
I20260812 01:14:02.818607 20268 ts_manager.cc:194] Registered new tserver with Master: 85b6e99ac5024d0fa2e2a02d05923829 (127.17.183.130:34241)
I20260812 01:14:02.819126 20268 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:50423
I20260812 01:14:02.824340 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.819040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:59115 (local address 127.17.183.190:44925)
0812 01:14:02.819075 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:02.819076 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:02.819179 (+ 103us) server_negotiation.cc:407] Connection header received
0812 01:14:02.819205 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:02.819205 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:02.819215 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:02.819287 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:02.819670 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.820251 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.820998 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.821171 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.821223 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.821972 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:02.821973 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:02.821973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:02.821979 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:02.823408 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.823712 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.823712 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.823712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.823764 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.823906 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.823906 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.823907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.824027 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:02.824076 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:02.824178 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 01:14:02.824276 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 01:14:02.824396 20911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.818969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44925 (local address 127.17.183.130:59115)
0812 01:14:02.819105 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:02.819115 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:02.819170 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:02.819293 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:02.819294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:02.819523 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:02.819588 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.819590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.820351 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.820352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.820928 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.820931 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.821234 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.821235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.821289 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.821628 (+ 339us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:02.821632 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:02.821897 (+ 265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:02.823475 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.823476 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.823477 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.823649 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.823817 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.823817 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.823818 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.823868 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.824077 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:02.824078 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:02.824114 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 01:14:02.824163 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 01:14:02.824312 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":76,"threads_started":1}
I20260812 01:14:02.824934 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 20668
I20260812 01:14:02.825027 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:02.825232 18142 external_mini_cluster.cc:1428] Setting key c9176f4b86948438449676e3a50c9c17
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:14:02.852465 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:44925
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:02.937748 20917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:02.937949 20917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:02.937974 20917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:02.939250 20917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:02.939301 20917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:02.939321 20917 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:14:02.939339 20917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:02.940917 20917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.183.190:44925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:02.941184 20917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:02.941432 20917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:02.946637 20930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:02.946635 20934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:02.946630 20928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:02.947013 20917 server_base.cc:1034] running on GCE node
I20260812 01:14:02.947242 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:02.947451 20917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:02.948565 20917 hybrid_clock.cc:648] HybridClock initialized: now 1786497242948547 us; error 33 us; skew 500 ppm
Aug 12 01:14:02 dist-test-slave-rwrg krb5kdc[20190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497242, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:02.951170 20917 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:14:02.951589 20917 webserver.cc:460] Webserver started at http://127.17.183.131:40983/ using document root <none> and password file <none>
I20260812 01:14:02.951794 20917 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:02.951855 20917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:02.951993 20917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:02.953020 20917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "2dbe02217df94be79c827921cd9b7d62"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "80dd62d4b24e4d5ccca52185463f02bf"
server_key_iv: "0ef51ebbf00e67019bffe56c97ed4fe1"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.953346 20917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "2dbe02217df94be79c827921cd9b7d62"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "80dd62d4b24e4d5ccca52185463f02bf"
server_key_iv: "0ef51ebbf00e67019bffe56c97ed4fe1"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.954613 20917 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:14:02.955284 20945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:02.955483 20917 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:02.955571 20917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "2dbe02217df94be79c827921cd9b7d62"
format_stamp: "Formatted at 2026-08-12 01:14:02 on dist-test-slave-rwrg"
server_key: "80dd62d4b24e4d5ccca52185463f02bf"
server_key_iv: "0ef51ebbf00e67019bffe56c97ed4fe1"
server_key_version: "encryptionkey@0"
I20260812 01:14:02.955626 20917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:02.977953 20917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:02.979813 20917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:02.979923 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:02.980440 20917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:02.980481 20917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:02.980590 20917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:02.980618 20917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:02.988535 20917 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:33675
I20260812 01:14:02.988679 21151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:33675 every 8 connection(s)
Aug 12 01:14:02 dist-test-slave-rwrg krb5kdc[20190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497242, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:02.988976 20917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:02.991683 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.980924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:45323 (local address 127.17.183.190:44925)
0812 01:14:02.980996 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:02.980999 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:02.981186 (+ 187us) server_negotiation.cc:407] Connection header received
0812 01:14:02.981721 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:02.981722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:02.981737 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:02.981830 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:02.982647 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.983508 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.985154 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.985538 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.985659 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.989391 (+ 3732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:02.989392 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:02.989393 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:02.989401 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:02.990539 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.990910 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.990911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.990911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.990963 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.991150 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.991151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.991151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.991256 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:02.991308 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:02.991544 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 01:14:02.991620 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 01:14:02.991845 20962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.980910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44925 (local address 127.17.183.131:45323)
0812 01:14:02.981055 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:02.981097 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:02.981611 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:02.981881 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:02.981884 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:02.982244 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:02.982520 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.982526 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.983633 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.983634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.985056 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.985060 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.985772 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.985773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.985959 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.987235 (+ 1276us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:02.987246 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:02.989275 (+ 2029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:02.990614 (+ 1339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.990621 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.990622 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.990840 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.991013 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.991014 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.991014 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.991100 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.991315 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:02.991320 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:02.991430 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 01:14:02.991513 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 01:14:02.991663 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260812 01:14:02.992389 21154 heartbeater.cc:347] Connected to a master server at 127.17.183.190:44925
I20260812 01:14:02.992515 21154 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:02.992731 21154 heartbeater.cc:511] Master 127.17.183.190:44925 requested a full tablet report, sending...
I20260812 01:14:02.993171 20267 ts_manager.cc:194] Registered new tserver with Master: 2dbe02217df94be79c827921cd9b7d62 (127.17.183.131:33675)
I20260812 01:14:02.993722 20267 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:45323
I20260812 01:14:02.997954 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 20917
I20260812 01:14:02.998044 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:02.998250 18142 external_mini_cluster.cc:1428] Setting key aaf748fe98646776e68f0baf6c152895
I20260812 01:14:02.999099 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:14:02.999153 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.993501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:36933 (local address 127.17.183.190:44925)
0812 01:14:02.993537 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:02.993539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:02.993744 (+ 205us) server_negotiation.cc:407] Connection header received
0812 01:14:02.993815 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:02.993816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:02.993826 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:02.993873 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:02.994359 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.994873 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.995517 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.995717 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.995770 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.996630 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:02.996632 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:02.996632 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:02.996637 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:02.997907 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.998330 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.998332 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.998332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.998396 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:02.998601 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:02.998602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:02.998602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:02.998727 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:02.998830 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:02.998997 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 01:14:02.999065 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 01:14:02.999174 21163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:02.993460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44925 (local address 127.17.183.131:36933)
0812 01:14:02.993663 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:02.993673 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:02.993758 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:02.993906 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:02.993907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:02.994197 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:02.994263 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.994266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.994961 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.994961 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.995451 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:02.995452 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:02.995787 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:02.995788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:02.995842 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:02.996188 (+ 346us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:02.996192 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:02.996470 (+ 278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:02.997992 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.997993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.997993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.998229 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.998456 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:02.998457 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:02.998457 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:02.998529 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:02.998836 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:02.998837 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:02.998882 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 01:14:02.998959 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 01:14:02.999065 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":130,"threads_started":1}
Aug 12 01:14:03 dist-test-slave-rwrg krb5kdc[20190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497243, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 01:14:03 dist-test-slave-rwrg krb5kdc[20190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497243, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:03.023497 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.016463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44748 (local address 127.17.183.190:44925)
0812 01:14:03.016537 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.016539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.016550 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:14:03.016639 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.016639 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.016649 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.016710 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:03.017310 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.017868 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.018601 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.018790 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.018869 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.021166 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:03.021167 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:03.021168 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:03.021175 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:03.022461 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:03.022828 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:03.022829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:03.022829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:03.022883 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:03.023054 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:03.023055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:03.023055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:03.023158 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:03.023251 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.023325 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.023388 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 01:14:03.025213 20267 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44748:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:03.026906 20267 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:03.033852 21184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.029426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:34241 (local address 127.0.0.1:34112)
0812 01:14:03.029890 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:03.029901 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:03.029970 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:03.030277 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:03.030278 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:03.030280 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:03.030387 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.030390 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.031324 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.031325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.032547 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.032550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.033553 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.033554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.033626 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.033629 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:03.033680 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 01:14:03.033759 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"mutex_wait_us":4,"thread_start_us":110,"threads_started":1}
I20260812 01:14:03.033862 21192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.029697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60708 (local address 127.17.183.131:33675)
0812 01:14:03.029901 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.029905 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.030224 (+ 319us) server_negotiation.cc:407] Connection header received
0812 01:14:03.030270 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.030273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.030288 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.030360 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:03.030544 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.031664 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.032875 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.033388 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.033479 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.033536 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.033699 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.033752 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":94,"threads_started":1}
I20260812 01:14:03.034222 21187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.029553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34112 (local address 127.17.183.130:34241)
0812 01:14:03.029748 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.029755 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.029966 (+ 211us) server_negotiation.cc:407] Connection header received
0812 01:14:03.030086 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.030088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.030100 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.030191 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:03.030481 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.031233 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.032624 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.033393 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.033466 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.033519 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.034072 (+ 553us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.034124 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":74,"threads_started":1}
I20260812 01:14:03.033860 21185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.029425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:33675 (local address 127.0.0.1:60708)
0812 01:14:03.030090 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:03.030120 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:03.030166 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:03.030425 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:03.030426 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:03.030428 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:03.030466 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.030467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.031758 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.031759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.032787 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.032788 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.033491 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.033493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.033577 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.033592 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 01:14:03.033681 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 01:14:03.033765 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":40,"spinlock_wait_cycles":768,"thread_start_us":89,"threads_started":1}
I20260812 01:14:03.034998 21186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.029425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:36411 (local address 127.0.0.1:56442)
0812 01:14:03.029820 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:03.029867 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:03.029955 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:03.030271 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:03.030275 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:03.030277 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:03.030398 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.030401 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.032560 (+ 2159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.032561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.033647 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.033649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.034754 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.034755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.034820 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.034824 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:03.034875 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 01:14:03.034927 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":30,"thread_start_us":61,"threads_started":1}
I20260812 01:14:03.035132 21021 tablet_service.cc:1467] Processing CreateTablet for tablet ecb01fef3ec14ac28975a1a985709641 (DEFAULT_TABLE table=test-table [id=4010374118f2435ca1c5bc88108cec14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:03.035292 21189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.029716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56442 (local address 127.17.183.129:36411)
0812 01:14:03.029878 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.029883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.029947 (+ 64us) server_negotiation.cc:407] Connection header received
0812 01:14:03.030064 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.030067 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.030094 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.030183 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:03.030483 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.031666 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.033738 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.034592 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.034663 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.034721 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.035142 (+ 421us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.035190 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":91,"threads_started":1}
I20260812 01:14:03.035144 20778 tablet_service.cc:1467] Processing CreateTablet for tablet ecb01fef3ec14ac28975a1a985709641 (DEFAULT_TABLE table=test-table [id=4010374118f2435ca1c5bc88108cec14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:03.035550 20778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecb01fef3ec14ac28975a1a985709641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:03.035550 21021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecb01fef3ec14ac28975a1a985709641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:03.035876 20516 tablet_service.cc:1467] Processing CreateTablet for tablet ecb01fef3ec14ac28975a1a985709641 (DEFAULT_TABLE table=test-table [id=4010374118f2435ca1c5bc88108cec14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:03.036213 20516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecb01fef3ec14ac28975a1a985709641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:03.039075 21193 tablet_bootstrap.cc:492] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: Bootstrap starting.
I20260812 01:14:03.039341 21194 tablet_bootstrap.cc:492] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: Bootstrap starting.
I20260812 01:14:03.039983 21194 tablet_bootstrap.cc:654] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:03.040241 21193 tablet_bootstrap.cc:654] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:03.040351 21194 log.cc:824] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:03.040665 21195 tablet_bootstrap.cc:492] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: Bootstrap starting.
I20260812 01:14:03.040673 21193 log.cc:824] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:03.041230 21194 tablet_bootstrap.cc:492] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: No bootstrap required, opened a new log
I20260812 01:14:03.041349 21193 tablet_bootstrap.cc:492] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: No bootstrap required, opened a new log
I20260812 01:14:03.041352 21195 tablet_bootstrap.cc:654] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:03.041365 21194 ts_tablet_manager.cc:1397] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 01:14:03.041431 21193 ts_tablet_manager.cc:1397] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:03.041718 21195 log.cc:824] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:03.043006 21194 raft_consensus.cc:348] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } }
I20260812 01:14:03.043005 21193 raft_consensus.cc:348] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } }
I20260812 01:14:03.043198 21194 raft_consensus.cc:374] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:03.043198 21193 raft_consensus.cc:374] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:03.043241 21194 raft_consensus.cc:729] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecbc5301e5cb46978753f6b57a71d4ac, State: Initialized, Role: FOLLOWER
I20260812 01:14:03.043244 21193 raft_consensus.cc:729] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dbe02217df94be79c827921cd9b7d62, State: Initialized, Role: FOLLOWER
I20260812 01:14:03.043363 21194 consensus_queue.cc:260] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } }
I20260812 01:14:03.043365 21193 consensus_queue.cc:260] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } }
I20260812 01:14:03.043656 20653 heartbeater.cc:503] Master 127.17.183.190:44925 was elected leader, sending a full tablet report...
I20260812 01:14:03.043655 21193 ts_tablet_manager.cc:1428] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:03.043665 21154 heartbeater.cc:503] Master 127.17.183.190:44925 was elected leader, sending a full tablet report...
I20260812 01:14:03.043640 21194 ts_tablet_manager.cc:1428] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 01:14:03.044646 21195 tablet_bootstrap.cc:492] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: No bootstrap required, opened a new log
I20260812 01:14:03.044714 21195 ts_tablet_manager.cc:1397] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 01:14:03.046188 21195 raft_consensus.cc:348] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } }
I20260812 01:14:03.046334 21195 raft_consensus.cc:374] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:03.046381 21195 raft_consensus.cc:729] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b6e99ac5024d0fa2e2a02d05923829, State: Initialized, Role: FOLLOWER
I20260812 01:14:03.046494 21195 consensus_queue.cc:260] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } }
I20260812 01:14:03.046751 21195 ts_tablet_manager.cc:1428] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:03.046814 20902 heartbeater.cc:503] Master 127.17.183.190:44925 was elected leader, sending a full tablet report...
W20260812 01:14:03.065485 20904 tablet.cc:2369] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:14:03.146658 20656 tablet.cc:2369] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:14:03.239665 21156 tablet.cc:2369] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:14:03.270697 21205 raft_consensus.cc:482] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:03.270841 21205 raft_consensus.cc:504] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } }
I20260812 01:14:03.271180 21205 leader_election.cc:288] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dbe02217df94be79c827921cd9b7d62 (127.17.183.131:33675), ecbc5301e5cb46978753f6b57a71d4ac (127.17.183.129:36411)
I20260812 01:14:03.275149 21189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.271539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:49357 (local address 127.17.183.129:36411)
0812 01:14:03.271610 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.271612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.271664 (+ 52us) server_negotiation.cc:407] Connection header received
0812 01:14:03.271756 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.271757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.271771 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.271816 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:03.271984 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.272758 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.274259 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.274782 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.274857 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.274865 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.275040 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.275078 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:14:03.275149 21192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.271514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:46137 (local address 127.17.183.131:33675)
0812 01:14:03.271561 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.271563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.271576 (+ 13us) server_negotiation.cc:407] Connection header received
0812 01:14:03.271612 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.271613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.271624 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.271700 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:03.271916 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.272735 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.274259 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.274781 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.274857 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.274865 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.275040 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.275091 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 01:14:03.275175 20711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.271426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:33675 (local address 127.17.183.130:46137)
0812 01:14:03.271488 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:03.271500 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:03.271551 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:03.271725 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:03.271726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:03.271728 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:03.271831 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.271833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.272826 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.272826 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.274169 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.274171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.274871 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.274872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.274964 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.274966 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:14:03.275018 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 01:14:03.275054 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":61}
I20260812 01:14:03.275183 21206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.271440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:36411 (local address 127.17.183.130:49357)
0812 01:14:03.271608 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:03.271617 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:03.271669 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:03.271843 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:03.271844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:03.271845 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:03.271911 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.271913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.272826 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.272826 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.274159 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.274164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.274871 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.274872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.274949 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.274953 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:03.275012 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 01:14:03.275054 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":87,"thread_start_us":106,"threads_started":1}
I20260812 01:14:03.275602 21061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecb01fef3ec14ac28975a1a985709641" candidate_uuid: "85b6e99ac5024d0fa2e2a02d05923829" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dbe02217df94be79c827921cd9b7d62" is_pre_election: true
I20260812 01:14:03.275630 20517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecb01fef3ec14ac28975a1a985709641" candidate_uuid: "85b6e99ac5024d0fa2e2a02d05923829" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" is_pre_election: true
I20260812 01:14:03.275775 20517 raft_consensus.cc:2454] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b6e99ac5024d0fa2e2a02d05923829 in term 0.
I20260812 01:14:03.275774 21061 raft_consensus.cc:2454] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b6e99ac5024d0fa2e2a02d05923829 in term 0.
I20260812 01:14:03.276028 20703 leader_election.cc:302] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b6e99ac5024d0fa2e2a02d05923829, ecbc5301e5cb46978753f6b57a71d4ac; no voters:
I20260812 01:14:03.276221 21205 raft_consensus.cc:2781] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:03.276315 21205 raft_consensus.cc:482] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:03.276351 21205 raft_consensus.cc:3037] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:03.277446 21205 raft_consensus.cc:504] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } }
I20260812 01:14:03.277616 21205 leader_election.cc:288] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [CANDIDATE]: Term 1 election: Requested vote from peers 2dbe02217df94be79c827921cd9b7d62 (127.17.183.131:33675), ecbc5301e5cb46978753f6b57a71d4ac (127.17.183.129:36411)
I20260812 01:14:03.277771 20517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecb01fef3ec14ac28975a1a985709641" candidate_uuid: "85b6e99ac5024d0fa2e2a02d05923829" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecbc5301e5cb46978753f6b57a71d4ac"
I20260812 01:14:03.277837 21061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecb01fef3ec14ac28975a1a985709641" candidate_uuid: "85b6e99ac5024d0fa2e2a02d05923829" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dbe02217df94be79c827921cd9b7d62"
I20260812 01:14:03.277853 20517 raft_consensus.cc:3037] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:03.277949 21061 raft_consensus.cc:3037] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:03.278620 20517 raft_consensus.cc:2454] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b6e99ac5024d0fa2e2a02d05923829 in term 1.
I20260812 01:14:03.278745 21061 raft_consensus.cc:2454] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b6e99ac5024d0fa2e2a02d05923829 in term 1.
I20260812 01:14:03.278821 20703 leader_election.cc:302] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b6e99ac5024d0fa2e2a02d05923829, ecbc5301e5cb46978753f6b57a71d4ac; no voters:
I20260812 01:14:03.278910 21205 raft_consensus.cc:2781] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:03.279099 21205 raft_consensus.cc:686] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 LEADER]: Becoming Leader. State: Replica: 85b6e99ac5024d0fa2e2a02d05923829, State: Running, Role: LEADER
I20260812 01:14:03.279204 21205 consensus_queue.cc:237] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } }
I20260812 01:14:03.280107 20267 catalog_manager.cc:5495] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85b6e99ac5024d0fa2e2a02d05923829 (127.17.183.130). New cstate: current_term: 1 leader_uuid: "85b6e99ac5024d0fa2e2a02d05923829" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } health_report { overall_health: UNKNOWN } } }
I20260812 01:14:03.319767 21187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.317350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34124 (local address 127.17.183.130:34241)
0812 01:14:03.317402 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.317404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.317426 (+ 22us) server_negotiation.cc:407] Connection header received
0812 01:14:03.317555 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.317555 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.317573 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.317643 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:03.317797 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.318262 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.319027 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.319213 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.319266 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.319458 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:03.319548 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:03.319630 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.319677 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.319694 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:14:03.321544 21061 raft_consensus.cc:1261] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62 [term 1 FOLLOWER]: Refusing update from remote peer 85b6e99ac5024d0fa2e2a02d05923829: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:03.321543 20517 raft_consensus.cc:1261] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 FOLLOWER]: Refusing update from remote peer 85b6e99ac5024d0fa2e2a02d05923829: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:03.321916 21208 consensus_queue.cc:1035] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:03.322054 21205 consensus_queue.cc:1035] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:03.324437 21213 mvcc.cc:205] Tried to move back new op lower bound from 7317492708642213888 to 7317492708472217600. Current Snapshot: MvccSnapshot[applied={T|T < 7317492708642213888}]
I20260812 01:14:03.325140 21219 mvcc.cc:205] Tried to move back new op lower bound from 7317492708642213888 to 7317492708472217600. Current Snapshot: MvccSnapshot[applied={T|T < 7317492708642213888}]
I20260812 01:14:03.329543 20268 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44748:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:03.329643 20268 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44748:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:03.330475 20268 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307: Sending DeleteTablet for 3 replicas of tablet ecb01fef3ec14ac28975a1a985709641
I20260812 01:14:03.330922 20778 tablet_service.cc:1514] Processing DeleteTablet for tablet ecb01fef3ec14ac28975a1a985709641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:03 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:34112
I20260812 01:14:03.330956 21021 tablet_service.cc:1514] Processing DeleteTablet for tablet ecb01fef3ec14ac28975a1a985709641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:03 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:60708
I20260812 01:14:03.331161 21240 tablet_replica.cc:330] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: stopping tablet replica
I20260812 01:14:03.331266 21240 raft_consensus.cc:2229] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:03.331249 20516 tablet_service.cc:1514] Processing DeleteTablet for tablet ecb01fef3ec14ac28975a1a985709641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:03 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:56442
I20260812 01:14:03.331382 21240 raft_consensus.cc:2258] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:03.331333 20268 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44748:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:03.331468 20268 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:03.331656 21241 tablet_replica.cc:330] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: stopping tablet replica
I20260812 01:14:03.331808 21241 raft_consensus.cc:2229] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:03.331863 21240 ts_tablet_manager.cc:1905] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:03.332012 21241 raft_consensus.cc:2258] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:03.332464 21241 ts_tablet_manager.cc:1905] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:03.332906 20778 tablet_service.cc:1467] Processing CreateTablet for tablet 5fe0c6078ec64d5f99aacc795127cea6 (DEFAULT_TABLE table=test-table [id=138121f6f9ce41ecb844cbe44f27bd11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:03.333037 20778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fe0c6078ec64d5f99aacc795127cea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:03.334239 21240 ts_tablet_manager.cc:1918] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:03.334319 21240 log.cc:1196] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/ecb01fef3ec14ac28975a1a985709641
I20260812 01:14:03.334555 21241 ts_tablet_manager.cc:1918] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:03.334601 21240 ts_tablet_manager.cc:1939] T ecb01fef3ec14ac28975a1a985709641 P 2dbe02217df94be79c827921cd9b7d62: Deleting consensus metadata
I20260812 01:14:03.334692 21195 tablet_bootstrap.cc:492] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829: Bootstrap starting.
I20260812 01:14:03.334712 21241 log.cc:1196] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/ecb01fef3ec14ac28975a1a985709641
I20260812 01:14:03.335049 20246 catalog_manager.cc:4841] TS 2dbe02217df94be79c827921cd9b7d62 (127.17.183.131:33675): tablet ecb01fef3ec14ac28975a1a985709641 (table test-table [id=4010374118f2435ca1c5bc88108cec14]) successfully deleted
I20260812 01:14:03.335073 21241 ts_tablet_manager.cc:1939] T ecb01fef3ec14ac28975a1a985709641 P ecbc5301e5cb46978753f6b57a71d4ac: Deleting consensus metadata
I20260812 01:14:03.335166 21195 tablet_bootstrap.cc:654] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:03.335740 21021 tablet_service.cc:1467] Processing CreateTablet for tablet 5fe0c6078ec64d5f99aacc795127cea6 (DEFAULT_TABLE table=test-table [id=138121f6f9ce41ecb844cbe44f27bd11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:03.335878 21021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fe0c6078ec64d5f99aacc795127cea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:03.335916 21195 tablet_bootstrap.cc:492] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829: No bootstrap required, opened a new log
I20260812 01:14:03.335973 21195 ts_tablet_manager.cc:1397] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:03.336139 21195 raft_consensus.cc:348] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.336227 21195 raft_consensus.cc:374] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:03.336251 21195 raft_consensus.cc:729] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b6e99ac5024d0fa2e2a02d05923829, State: Initialized, Role: FOLLOWER
I20260812 01:14:03.336305 21195 consensus_queue.cc:260] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.336402 21195 ts_tablet_manager.cc:1428] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:03.336797 20245 catalog_manager.cc:4841] TS ecbc5301e5cb46978753f6b57a71d4ac (127.17.183.129:36411): tablet ecb01fef3ec14ac28975a1a985709641 (table test-table [id=4010374118f2435ca1c5bc88108cec14]) successfully deleted
I20260812 01:14:03.336979 21236 tablet_replica.cc:330] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: stopping tablet replica
I20260812 01:14:03.337128 21193 tablet_bootstrap.cc:492] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62: Bootstrap starting.
I20260812 01:14:03.337133 21236 raft_consensus.cc:2229] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:03.337364 21236 raft_consensus.cc:2258] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:03.337409 20516 tablet_service.cc:1467] Processing CreateTablet for tablet 5fe0c6078ec64d5f99aacc795127cea6 (DEFAULT_TABLE table=test-table [id=138121f6f9ce41ecb844cbe44f27bd11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:03.337528 20516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fe0c6078ec64d5f99aacc795127cea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:03.337544 21193 tablet_bootstrap.cc:654] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:03.338514 21194 tablet_bootstrap.cc:492] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac: Bootstrap starting.
I20260812 01:14:03.338914 21194 tablet_bootstrap.cc:654] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:03.339146 21236 ts_tablet_manager.cc:1905] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:03.339744 21194 tablet_bootstrap.cc:492] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac: No bootstrap required, opened a new log
I20260812 01:14:03.339802 21194 ts_tablet_manager.cc:1397] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:03.339949 21194 raft_consensus.cc:348] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.340021 21194 raft_consensus.cc:374] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:03.340044 21194 raft_consensus.cc:729] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecbc5301e5cb46978753f6b57a71d4ac, State: Initialized, Role: FOLLOWER
I20260812 01:14:03.340106 21194 consensus_queue.cc:260] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.340412 21194 ts_tablet_manager.cc:1428] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:03.340739 21236 ts_tablet_manager.cc:1918] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:03.340818 21236 log.cc:1196] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/ecb01fef3ec14ac28975a1a985709641
I20260812 01:14:03.341126 21236 ts_tablet_manager.cc:1939] T ecb01fef3ec14ac28975a1a985709641 P 85b6e99ac5024d0fa2e2a02d05923829: Deleting consensus metadata
I20260812 01:14:03.341542 20243 catalog_manager.cc:4841] TS 85b6e99ac5024d0fa2e2a02d05923829 (127.17.183.130:34241): tablet ecb01fef3ec14ac28975a1a985709641 (table test-table [id=4010374118f2435ca1c5bc88108cec14]) successfully deleted
I20260812 01:14:03.341794 21193 tablet_bootstrap.cc:492] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62: No bootstrap required, opened a new log
I20260812 01:14:03.341845 21193 ts_tablet_manager.cc:1397] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 01:14:03.341987 21193 raft_consensus.cc:348] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.342061 21193 raft_consensus.cc:374] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:03.342092 21193 raft_consensus.cc:729] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dbe02217df94be79c827921cd9b7d62, State: Initialized, Role: FOLLOWER
I20260812 01:14:03.342139 21193 consensus_queue.cc:260] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.342226 21193 ts_tablet_manager.cc:1428] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:03.452054 21203 raft_consensus.cc:482] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:03.452162 21203 raft_consensus.cc:504] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.452555 21203 leader_election.cc:288] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b6e99ac5024d0fa2e2a02d05923829 (127.17.183.130:34241), 2dbe02217df94be79c827921cd9b7d62 (127.17.183.131:33675)
I20260812 01:14:03.456067 21247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.452799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:33675 (local address 127.17.183.129:59477)
0812 01:14:03.452966 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:03.452975 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:03.453036 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:03.453280 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:03.453281 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:03.453282 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:03.453377 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.453378 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.454036 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.454055 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.455018 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.455022 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.455783 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.455784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.455862 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.455867 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:14:03.455931 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 01:14:03.455973 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":2,"thread_start_us":65,"threads_started":1}
I20260812 01:14:03.456101 21192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.452852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:59477 (local address 127.17.183.131:33675)
0812 01:14:03.452895 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.452897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.453051 (+ 154us) server_negotiation.cc:407] Connection header received
0812 01:14:03.453089 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.453090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.453101 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.453162 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:03.453452 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.453944 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.455147 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.455681 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.455747 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.455755 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.455953 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.456015 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:14:03.456375 21061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fe0c6078ec64d5f99aacc795127cea6" candidate_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dbe02217df94be79c827921cd9b7d62" is_pre_election: true
I20260812 01:14:03.456482 21061 raft_consensus.cc:2454] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecbc5301e5cb46978753f6b57a71d4ac in term 0.
I20260812 01:14:03.456691 20443 leader_election.cc:302] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dbe02217df94be79c827921cd9b7d62, ecbc5301e5cb46978753f6b57a71d4ac; no voters:
I20260812 01:14:03.456846 21203 raft_consensus.cc:2781] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:03.456899 21203 raft_consensus.cc:482] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:03.456928 21203 raft_consensus.cc:3037] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:03.457723 21203 raft_consensus.cc:504] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.457886 21203 leader_election.cc:288] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [CANDIDATE]: Term 1 election: Requested vote from peers 85b6e99ac5024d0fa2e2a02d05923829 (127.17.183.130:34241), 2dbe02217df94be79c827921cd9b7d62 (127.17.183.131:33675)
I20260812 01:14:03.458117 21061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fe0c6078ec64d5f99aacc795127cea6" candidate_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dbe02217df94be79c827921cd9b7d62"
I20260812 01:14:03.458204 21061 raft_consensus.cc:3037] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:03.458710 21248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.452797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:34241 (local address 127.17.183.129:42703)
0812 01:14:03.452963 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:03.452974 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:03.453106 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:03.453260 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:03.453261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:03.453263 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:03.453378 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.453380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.454085 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.454093 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.455015 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.455018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.455780 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.455782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.455862 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.455869 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 01:14:03.458615 (+ 2746us) client_negotiation.cc:240] Negotiation successful
0812 01:14:03.458650 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":66,"thread_start_us":96,"threads_started":1}
I20260812 01:14:03.458760 21187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.452829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:42703 (local address 127.17.183.130:34241)
0812 01:14:03.452882 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.452886 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.453071 (+ 185us) server_negotiation.cc:407] Connection header received
0812 01:14:03.453184 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.453185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.453194 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.453236 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:03.453513 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.453950 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.455093 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.455648 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.455729 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.455740 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.458645 (+ 2905us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.458693 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 01:14:03.459048 21061 raft_consensus.cc:2454] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecbc5301e5cb46978753f6b57a71d4ac in term 1.
I20260812 01:14:03.459008 20814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fe0c6078ec64d5f99aacc795127cea6" candidate_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b6e99ac5024d0fa2e2a02d05923829"
I20260812 01:14:03.459153 20814 raft_consensus.cc:3037] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:03.459270 20443 leader_election.cc:302] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dbe02217df94be79c827921cd9b7d62, ecbc5301e5cb46978753f6b57a71d4ac; no voters:
I20260812 01:14:03.459496 21203 raft_consensus.cc:2781] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:03.459699 21203 raft_consensus.cc:686] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 LEADER]: Becoming Leader. State: Replica: ecbc5301e5cb46978753f6b57a71d4ac, State: Running, Role: LEADER
I20260812 01:14:03.459811 21203 consensus_queue.cc:237] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.460053 20814 raft_consensus.cc:2454] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecbc5301e5cb46978753f6b57a71d4ac in term 1.
I20260812 01:14:03.460180 20817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fe0c6078ec64d5f99aacc795127cea6" candidate_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b6e99ac5024d0fa2e2a02d05923829" is_pre_election: true
I20260812 01:14:03.460278 20817 raft_consensus.cc:2362] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecbc5301e5cb46978753f6b57a71d4ac in term 1. Re-sending same reply.
I20260812 01:14:03.460623 20267 catalog_manager.cc:5495] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac reported cstate change: term changed from 0 to 1, leader changed from <none> to ecbc5301e5cb46978753f6b57a71d4ac (127.17.183.129). New cstate: current_term: 1 leader_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } health_report { overall_health: UNKNOWN } } }
Aug 12 01:14:03 dist-test-slave-rwrg krb5kdc[20190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497242, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:03.511860 21267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.505204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44925 (local address 127.0.0.1:44750)
0812 01:14:03.505405 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:03.505416 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:03.505483 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:03.505645 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:03.505646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:03.505947 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:03.505996 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.505998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.506615 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.506616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.507139 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.507141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.507497 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.507498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.507542 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.508017 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:03.508021 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:03.509572 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:03.510945 (+ 1373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:03.510952 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:03.510954 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:03.511160 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:03.511347 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:03.511347 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:03.511348 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:03.511403 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:03.511604 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:03.511611 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:03.511650 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 01:14:03.511699 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 01:14:03.511787 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":121,"threads_started":1}
I20260812 01:14:03.511919 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.505280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44750 (local address 127.17.183.190:44925)
0812 01:14:03.505365 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.505367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.505481 (+ 114us) server_negotiation.cc:407] Connection header received
0812 01:14:03.505529 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.505530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.505539 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.505603 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:03.506064 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.506543 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.507208 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.507429 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.507482 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.509659 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:03.509660 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:03.509660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:03.509667 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:03.510874 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:03.511224 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:03.511225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:03.511225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:03.511290 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:03.511454 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:03.511454 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:03.511454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:03.511552 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:03.511601 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.511730 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.511835 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":49}
I20260812 01:14:03.513954 20267 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:44750:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 01:14:03.514235 20267 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:03.515862 20516 tablet_service.cc:1467] Processing CreateTablet for tablet 60e67d6b856c47e4a5fe7e46b18cb611 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=54372fae48b4423981167e9662acf1b2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:14:03.515895 20778 tablet_service.cc:1467] Processing CreateTablet for tablet 60e67d6b856c47e4a5fe7e46b18cb611 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=54372fae48b4423981167e9662acf1b2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:14:03.516096 20516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60e67d6b856c47e4a5fe7e46b18cb611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:03.516147 20778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60e67d6b856c47e4a5fe7e46b18cb611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:03.517673 21195 tablet_bootstrap.cc:492] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829: Bootstrap starting.
I20260812 01:14:03.517737 21194 tablet_bootstrap.cc:492] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: Bootstrap starting.
I20260812 01:14:03.517853 21021 tablet_service.cc:1467] Processing CreateTablet for tablet 60e67d6b856c47e4a5fe7e46b18cb611 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=54372fae48b4423981167e9662acf1b2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:14:03.518011 21021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60e67d6b856c47e4a5fe7e46b18cb611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:03.518082 21195 tablet_bootstrap.cc:654] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:03.518276 21194 tablet_bootstrap.cc:654] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:03.519043 21194 tablet_bootstrap.cc:492] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: No bootstrap required, opened a new log
I20260812 01:14:03.519114 21194 ts_tablet_manager.cc:1397] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:03.519275 21194 raft_consensus.cc:348] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.519354 21194 raft_consensus.cc:374] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:03.519387 21194 raft_consensus.cc:729] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecbc5301e5cb46978753f6b57a71d4ac, State: Initialized, Role: FOLLOWER
I20260812 01:14:03.519434 21194 consensus_queue.cc:260] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.519531 21194 ts_tablet_manager.cc:1428] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:03.519640 21193 tablet_bootstrap.cc:492] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62: Bootstrap starting.
I20260812 01:14:03.519594 21203 tablet_replica.cc:439] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } }
I20260812 01:14:03.519695 21203 tablet_replica.cc:442] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:03.520090 21193 tablet_bootstrap.cc:654] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:03.520226 21195 tablet_bootstrap.cc:492] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829: No bootstrap required, opened a new log
I20260812 01:14:03.520272 21195 ts_tablet_manager.cc:1397] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 01:14:03.520385 21195 raft_consensus.cc:348] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.520444 21195 raft_consensus.cc:374] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:03.520460 21195 raft_consensus.cc:729] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b6e99ac5024d0fa2e2a02d05923829, State: Initialized, Role: FOLLOWER
I20260812 01:14:03.520550 21195 consensus_queue.cc:260] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.520668 21195 ts_tablet_manager.cc:1428] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:03.520697 21224 tablet_replica.cc:439] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } }
I20260812 01:14:03.520785 21224 tablet_replica.cc:442] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:03.520797 21193 tablet_bootstrap.cc:492] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62: No bootstrap required, opened a new log
I20260812 01:14:03.520840 21193 ts_tablet_manager.cc:1397] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:03.521013 21193 raft_consensus.cc:348] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.521090 21193 raft_consensus.cc:374] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:03.521117 21193 raft_consensus.cc:729] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dbe02217df94be79c827921cd9b7d62, State: Initialized, Role: FOLLOWER
I20260812 01:14:03.521183 21193 consensus_queue.cc:260] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.521310 21193 ts_tablet_manager.cc:1428] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:03.521328 21204 tablet_replica.cc:439] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } }
I20260812 01:14:03.521428 21204 tablet_replica.cc:442] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:03.832656 21203 raft_consensus.cc:482] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:03.832779 21203 raft_consensus.cc:504] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.832988 21203 leader_election.cc:288] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b6e99ac5024d0fa2e2a02d05923829 (127.17.183.130:34241), 2dbe02217df94be79c827921cd9b7d62 (127.17.183.131:33675)
I20260812 01:14:03.833230 20817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60e67d6b856c47e4a5fe7e46b18cb611" candidate_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b6e99ac5024d0fa2e2a02d05923829" is_pre_election: true
I20260812 01:14:03.833230 21061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60e67d6b856c47e4a5fe7e46b18cb611" candidate_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dbe02217df94be79c827921cd9b7d62" is_pre_election: true
I20260812 01:14:03.833344 21061 raft_consensus.cc:2454] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecbc5301e5cb46978753f6b57a71d4ac in term 0.
I20260812 01:14:03.833344 20817 raft_consensus.cc:2454] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecbc5301e5cb46978753f6b57a71d4ac in term 0.
I20260812 01:14:03.833498 20438 leader_election.cc:302] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b6e99ac5024d0fa2e2a02d05923829, ecbc5301e5cb46978753f6b57a71d4ac; no voters:
I20260812 01:14:03.833643 21203 raft_consensus.cc:2781] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:03.833705 21203 raft_consensus.cc:482] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:03.833724 21203 raft_consensus.cc:3037] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:03.834378 21203 raft_consensus.cc:504] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.834512 21203 leader_election.cc:288] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [CANDIDATE]: Term 1 election: Requested vote from peers 85b6e99ac5024d0fa2e2a02d05923829 (127.17.183.130:34241), 2dbe02217df94be79c827921cd9b7d62 (127.17.183.131:33675)
I20260812 01:14:03.834650 20817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60e67d6b856c47e4a5fe7e46b18cb611" candidate_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b6e99ac5024d0fa2e2a02d05923829"
I20260812 01:14:03.834735 20817 raft_consensus.cc:3037] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:03.834699 21061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60e67d6b856c47e4a5fe7e46b18cb611" candidate_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dbe02217df94be79c827921cd9b7d62"
I20260812 01:14:03.834791 21061 raft_consensus.cc:3037] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:03.835386 21061 raft_consensus.cc:2454] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecbc5301e5cb46978753f6b57a71d4ac in term 1.
I20260812 01:14:03.835618 20817 raft_consensus.cc:2454] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecbc5301e5cb46978753f6b57a71d4ac in term 1.
I20260812 01:14:03.835625 20443 leader_election.cc:302] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dbe02217df94be79c827921cd9b7d62, ecbc5301e5cb46978753f6b57a71d4ac; no voters:
I20260812 01:14:03.835732 21203 raft_consensus.cc:2781] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:03.835800 21203 raft_consensus.cc:686] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 LEADER]: Becoming Leader. State: Replica: ecbc5301e5cb46978753f6b57a71d4ac, State: Running, Role: LEADER
I20260812 01:14:03.835844 21203 consensus_queue.cc:237] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } }
I20260812 01:14:03.836113 21253 tablet_replica.cc:439] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: TxnStatusTablet state changed. Reason: New leader ecbc5301e5cb46978753f6b57a71d4ac. Latest consensus state: current_term: 1 leader_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } }
I20260812 01:14:03.836205 21253 tablet_replica.cc:442] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:14:03.836364 21276 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 01:14:03.836540 21276 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 01:14:03.836465 20267 catalog_manager.cc:5495] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac reported cstate change: term changed from 0 to 1, leader changed from <none> to ecbc5301e5cb46978753f6b57a71d4ac (127.17.183.129). New cstate: current_term: 1 leader_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } health_report { overall_health: UNKNOWN } } }
I20260812 01:14:03.873355 21283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.870631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56452 (local address 127.17.183.129:36411)
0812 01:14:03.870746 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.870748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.870758 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:03.870832 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.870832 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.870853 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.870944 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:03.871088 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.871620 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.872395 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.872702 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.872780 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.872966 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:03.873095 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:03.873180 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.873230 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.873253 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":57,"threads_started":1}
I20260812 01:14:03.873344 21267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.870555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:36411 (local address 127.0.0.1:56452)
0812 01:14:03.870667 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:03.870679 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:03.870733 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:03.870951 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:03.870952 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:03.870953 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:14:03.871005 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.871007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.871708 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.871709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.872304 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.872305 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.872782 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.872783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.872844 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.872867 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:14:03.873166 (+ 299us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:14:03.873178 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 01:14:03.873227 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 01:14:03.873273 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 01:14:03.874671 21061 raft_consensus.cc:1261] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62 [term 1 FOLLOWER]: Refusing update from remote peer ecbc5301e5cb46978753f6b57a71d4ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:03.874840 20817 raft_consensus.cc:1261] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 FOLLOWER]: Refusing update from remote peer ecbc5301e5cb46978753f6b57a71d4ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:03.874974 21253 consensus_queue.cc:1035] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:03.875109 21203 consensus_queue.cc:1035] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:03.875866 21224 tablet_replica.cc:439] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829: TxnStatusTablet state changed. Reason: New leader ecbc5301e5cb46978753f6b57a71d4ac. Latest consensus state: current_term: 1 leader_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } }
I20260812 01:14:03.875974 21224 tablet_replica.cc:442] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:03.876061 21204 tablet_replica.cc:439] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62: TxnStatusTablet state changed. Reason: New leader ecbc5301e5cb46978753f6b57a71d4ac. Latest consensus state: current_term: 1 leader_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } }
I20260812 01:14:03.876173 21204 tablet_replica.cc:442] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:03.876598 21253 tablet_replica.cc:439] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } }
I20260812 01:14:03.876679 21253 tablet_replica.cc:442] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:14:03.877425 21253 tablet_replica.cc:439] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } }
I20260812 01:14:03.877512 21253 tablet_replica.cc:442] T 60e67d6b856c47e4a5fe7e46b18cb611 P ecbc5301e5cb46978753f6b57a71d4ac: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:14:03.877532 21224 tablet_replica.cc:439] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } }
I20260812 01:14:03.877612 21224 tablet_replica.cc:442] T 60e67d6b856c47e4a5fe7e46b18cb611 P 85b6e99ac5024d0fa2e2a02d05923829: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:03.877943 21204 tablet_replica.cc:439] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbc5301e5cb46978753f6b57a71d4ac" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36411 } } peers { permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 } } peers { permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 } } }
I20260812 01:14:03.878036 21204 tablet_replica.cc:442] T 60e67d6b856c47e4a5fe7e46b18cb611 P 2dbe02217df94be79c827921cd9b7d62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:03.882081 21283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.879838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56464 (local address 127.17.183.129:36411)
0812 01:14:03.879903 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.879905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.879913 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:03.879934 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.879935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.879957 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.880012 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:03.880155 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.880683 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.881439 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.881646 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.881721 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.881866 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:03.881897 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:03.881939 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.881992 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.882010 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 01:14:03.887130 21283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.884724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:33953 (local address 127.17.183.129:36411)
0812 01:14:03.884757 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.884759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.884909 (+ 150us) server_negotiation.cc:407] Connection header received
0812 01:14:03.884980 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.884981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.884989 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.885032 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:03.885163 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.885571 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.886416 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.886598 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.886662 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.886846 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:03.886873 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:03.886940 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.886997 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.887034 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":15}
I20260812 01:14:03.887159 21309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.884686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:36411 (local address 127.17.183.129:33953)
0812 01:14:03.884844 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:03.884852 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:03.884921 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:03.885040 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:03.885041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:03.885042 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:14:03.885102 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.885103 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.885644 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.885645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.886324 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:03.886326 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.886673 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.886674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:03.886747 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.886760 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:14:03.886941 (+ 181us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:14:03.886943 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:14:03.886994 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 01:14:03.887052 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":16,"thread_start_us":85,"threads_started":1}
I20260812 01:14:03.889201 20817 raft_consensus.cc:1261] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 FOLLOWER]: Refusing update from remote peer ecbc5301e5cb46978753f6b57a71d4ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:03.889213 21061 raft_consensus.cc:1261] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62 [term 1 FOLLOWER]: Refusing update from remote peer ecbc5301e5cb46978753f6b57a71d4ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:03.889432 21203 consensus_queue.cc:1035] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b6e99ac5024d0fa2e2a02d05923829" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 34241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:03.889644 21203 consensus_queue.cc:1035] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dbe02217df94be79c827921cd9b7d62" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:03.891459 21286 mvcc.cc:205] Tried to move back new op lower bound from 7317492710968729600 to 7317492709211873280. Current Snapshot: MvccSnapshot[applied={T|T < 7317492710968729600}]
I20260812 01:14:03.904841 20268 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44748:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:03.904937 20268 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44748:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:03.905639 20268 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a750b2ed32674a8a8914a84ec0739307: Sending DeleteTablet for 3 replicas of tablet 5fe0c6078ec64d5f99aacc795127cea6
I20260812 01:14:03.906005 20778 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fe0c6078ec64d5f99aacc795127cea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:03 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:34112
I20260812 01:14:03.906061 20516 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fe0c6078ec64d5f99aacc795127cea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:03 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:56442
I20260812 01:14:03.906224 21021 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fe0c6078ec64d5f99aacc795127cea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:03 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:60708
I20260812 01:14:03.906308 21319 tablet_replica.cc:330] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac: stopping tablet replica
I20260812 01:14:03.906394 21319 raft_consensus.cc:2229] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:03.906419 21318 tablet_replica.cc:330] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829: stopping tablet replica
I20260812 01:14:03.906477 21318 raft_consensus.cc:2229] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:03.906486 21319 raft_consensus.cc:2258] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:03.906515 21318 raft_consensus.cc:2258] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:03.906778 21319 ts_tablet_manager.cc:1905] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:03.906790 21318 ts_tablet_manager.cc:1905] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:03.908384 21318 ts_tablet_manager.cc:1918] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:03.908459 21318 log.cc:1196] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/5fe0c6078ec64d5f99aacc795127cea6
I20260812 01:14:03.908574 21319 ts_tablet_manager.cc:1918] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:03.908641 21319 log.cc:1196] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/5fe0c6078ec64d5f99aacc795127cea6
I20260812 01:14:03.908810 21318 ts_tablet_manager.cc:1939] T 5fe0c6078ec64d5f99aacc795127cea6 P 85b6e99ac5024d0fa2e2a02d05923829: Deleting consensus metadata
I20260812 01:14:03.908924 21319 ts_tablet_manager.cc:1939] T 5fe0c6078ec64d5f99aacc795127cea6 P ecbc5301e5cb46978753f6b57a71d4ac: Deleting consensus metadata
I20260812 01:14:03.909153 20243 catalog_manager.cc:4841] TS 85b6e99ac5024d0fa2e2a02d05923829 (127.17.183.130:34241): tablet 5fe0c6078ec64d5f99aacc795127cea6 (table test-table [id=138121f6f9ce41ecb844cbe44f27bd11]) successfully deleted
I20260812 01:14:03.909219 20245 catalog_manager.cc:4841] TS ecbc5301e5cb46978753f6b57a71d4ac (127.17.183.129:36411): tablet 5fe0c6078ec64d5f99aacc795127cea6 (table test-table [id=138121f6f9ce41ecb844cbe44f27bd11]) successfully deleted
I20260812 01:14:03.909308 21321 tablet_replica.cc:330] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62: stopping tablet replica
I20260812 01:14:03.909379 21321 raft_consensus.cc:2229] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:03.909431 21321 raft_consensus.cc:2258] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:03.910027 21321 ts_tablet_manager.cc:1905] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:03.911729 21321 ts_tablet_manager.cc:1918] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:03.911796 21321 log.cc:1196] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/5fe0c6078ec64d5f99aacc795127cea6
I20260812 01:14:03.912021 21321 ts_tablet_manager.cc:1939] T 5fe0c6078ec64d5f99aacc795127cea6 P 2dbe02217df94be79c827921cd9b7d62: Deleting consensus metadata
I20260812 01:14:03.912357 20246 catalog_manager.cc:4841] TS 2dbe02217df94be79c827921cd9b7d62 (127.17.183.131:33675): tablet 5fe0c6078ec64d5f99aacc795127cea6 (table test-table [id=138121f6f9ce41ecb844cbe44f27bd11]) successfully deleted
Aug 12 01:14:03 dist-test-slave-rwrg krb5kdc[20190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497243, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:14:03.921139 21283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.909766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56478 (local address 127.17.183.129:36411)
0812 01:14:03.909806 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.909808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.912485 (+ 2677us) server_negotiation.cc:407] Connection header received
0812 01:14:03.912583 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.912584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.912595 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.912654 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:03.913249 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.913732 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.914466 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.914720 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.914792 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.918175 (+ 3383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:03.918184 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:03.918184 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:03.918194 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:03.919816 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:03.920234 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:03.920237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:03.920237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:03.920292 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:03.920577 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:03.920577 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:03.920578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:03.920706 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:03.920828 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.920953 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.921014 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 01:14:03.921525 20643 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56478
I20260812 01:14:03.929713 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:03.922658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44754 (local address 127.17.183.190:44925)
0812 01:14:03.922708 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:03.922710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:03.922766 (+ 56us) server_negotiation.cc:407] Connection header received
0812 01:14:03.922828 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:03.922828 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:03.922840 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:03.922911 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:03.923478 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.924227 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.924973 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:03.925264 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:03.925340 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:03.926417 (+ 1077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:03.926419 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:03.926419 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:03.926427 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:03.928017 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:03.928670 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:03.928671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:03.928672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:03.928774 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:03.929058 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:03.929059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:03.929059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:03.929191 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:03.929338 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:03.929510 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 01:14:03.929600 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 01:14:03.929970 20268 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44754
I20260812 01:14:03.930629 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 20398
I20260812 01:14:03.949566 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 20668
I20260812 01:14:03.964671 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 20917
I20260812 01:14:03.977687 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 20209
2026-08-12T01:14:03Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3084 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:04 dist-test-slave-rwrg krb5kdc[21332](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:04 dist-test-slave-rwrg krb5kdc[21332](info): set up 2 sockets
Aug 12 01:14:04 dist-test-slave-rwrg krb5kdc[21332](info): commencing operation
krb5kdc: starting...
W20260812 01:14:05.283243 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:05 dist-test-slave-rwrg krb5kdc[21332](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497245, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:14:05.403649 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43171
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:43171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:05.488196 21354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:05.488469 21354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:05.488516 21354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:05.489662 21354 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:05.489702 21354 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 01:14:05.489715 21354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:05.489730 21354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:05.489742 21354 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:05.489754 21354 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:05.491138 21354 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:43171
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:05.491317 21354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:05.491493 21354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:05.496371 21363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:05.496405 21362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:05.496379 21367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:05.496616 21354 server_base.cc:1034] running on GCE node
I20260812 01:14:05.497653 21354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:05.497957 21354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:05.499140 21354 hybrid_clock.cc:648] HybridClock initialized: now 1786497245499116 us; error 38 us; skew 500 ppm
Aug 12 01:14:05 dist-test-slave-rwrg krb5kdc[21332](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497245, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:05.501662 21354 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:14:05.502166 21354 webserver.cc:460] Webserver started at http://127.17.183.190:39705/ using document root <none> and password file <none>
I20260812 01:14:05.502398 21354 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:05.502465 21354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:05.502619 21354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:05.503655 21354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "c4bb0d2971ca47479423a77f9404ddf2"
format_stamp: "Formatted at 2026-08-12 01:14:05 on dist-test-slave-rwrg"
server_key: "cd0125f75bca3b7f69b9e715ce3de882"
server_key_iv: "b492b6bbe8f56bd6a5f9054e7fd82e01"
server_key_version: "encryptionkey@0"
I20260812 01:14:05.504034 21354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "c4bb0d2971ca47479423a77f9404ddf2"
format_stamp: "Formatted at 2026-08-12 01:14:05 on dist-test-slave-rwrg"
server_key: "cd0125f75bca3b7f69b9e715ce3de882"
server_key_iv: "b492b6bbe8f56bd6a5f9054e7fd82e01"
server_key_version: "encryptionkey@0"
I20260812 01:14:05.505570 21354 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:05.506340 21381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:05.506510 21354 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:05.506621 21354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "c4bb0d2971ca47479423a77f9404ddf2"
format_stamp: "Formatted at 2026-08-12 01:14:05 on dist-test-slave-rwrg"
server_key: "cd0125f75bca3b7f69b9e715ce3de882"
server_key_iv: "b492b6bbe8f56bd6a5f9054e7fd82e01"
server_key_version: "encryptionkey@0"
I20260812 01:14:05.506696 21354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:05.519673 21354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:05.521588 21354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:05.521763 21354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:05.527097 21354 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:43171
I20260812 01:14:05.527172 21489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:43171 every 8 connection(s)
I20260812 01:14:05.527554 21354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:05.528175 21491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:05.528946 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 21354
I20260812 01:14:05.529049 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:05.529225 18142 external_mini_cluster.cc:1428] Setting key e72b0fdd71e011554393cd3fe417c2a8
I20260812 01:14:05.531396 21491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2: Bootstrap starting.
I20260812 01:14:05.532081 21491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:05.532413 21491 log.cc:824] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:05.533160 21491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2: No bootstrap required, opened a new log
I20260812 01:14:05.535274 21491 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4bb0d2971ca47479423a77f9404ddf2" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43171 } }
I20260812 01:14:05.535400 21491 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:05.535422 21491 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4bb0d2971ca47479423a77f9404ddf2, State: Initialized, Role: FOLLOWER
I20260812 01:14:05.535555 21491 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4bb0d2971ca47479423a77f9404ddf2" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43171 } }
I20260812 01:14:05.535636 21491 raft_consensus.cc:388] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:05.535660 21491 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:05.535733 21491 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:05.536428 21491 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4bb0d2971ca47479423a77f9404ddf2" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43171 } }
Aug 12 01:14:05 dist-test-slave-rwrg krb5kdc[21332](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497245, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:05.536562 21491 leader_election.cc:302] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4bb0d2971ca47479423a77f9404ddf2; no voters:
I20260812 01:14:05.536769 21491 leader_election.cc:288] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:05.536826 21498 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:05.536986 21498 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [term 1 LEADER]: Becoming Leader. State: Replica: c4bb0d2971ca47479423a77f9404ddf2, State: Running, Role: LEADER
I20260812 01:14:05.537032 21491 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:05.537074 21498 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4bb0d2971ca47479423a77f9404ddf2" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43171 } }
I20260812 01:14:05.537438 21498 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4bb0d2971ca47479423a77f9404ddf2. Latest consensus state: current_term: 1 leader_uuid: "c4bb0d2971ca47479423a77f9404ddf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4bb0d2971ca47479423a77f9404ddf2" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43171 } } }
I20260812 01:14:05.537451 21499 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4bb0d2971ca47479423a77f9404ddf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4bb0d2971ca47479423a77f9404ddf2" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43171 } } }
I20260812 01:14:05.537528 21498 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:05.537562 21499 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:05.537768 21506 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:05.538303 21506 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:05.540324 21506 catalog_manager.cc:1347] Generated new cluster ID: 637d74fc5a2945488ea93978a2d59daa
I20260812 01:14:05.540387 21506 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:05.540896 21496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:05.529816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48442 (local address 127.17.183.190:43171)
0812 01:14:05.530012 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:05.530022 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:05.530058 (+ 36us) server_negotiation.cc:407] Connection header received
0812 01:14:05.530642 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:05.530651 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:05.530714 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:05.530859 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:05.531422 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.532823 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.533629 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.534297 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.534427 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:05.537100 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:05.537105 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:05.537105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:05.537118 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:05.539247 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:05.539621 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:05.539623 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:05.539624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:05.539723 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:05.539931 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:05.539932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:05.539932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:05.540162 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:05.540282 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:05.540599 (+ 317us) server_negotiation.cc:299] Negotiation successful
0812 01:14:05.540718 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
I20260812 01:14:05.567281 21506 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:05.567867 21506 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:05.577692 21506 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2: Generated new TSK 0
I20260812 01:14:05.577898 21506 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:14:05.614851 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43171
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:05.710000 21529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:05.710350 21529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:05.710413 21529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:05.712122 21529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:05.712178 21529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:05.712209 21529 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 01:14:05.712239 21529 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:14:05.712263 21529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:05.714615 21529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.183.190:43171
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:05.714870 21529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:05.715143 21529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:05.720338 21539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:05.720338 21540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:05.720403 21542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:05.720613 21529 server_base.cc:1034] running on GCE node
I20260812 01:14:05.720789 21529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:05.720997 21529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:05.722157 21529 hybrid_clock.cc:648] HybridClock initialized: now 1786497245722145 us; error 34 us; skew 500 ppm
Aug 12 01:14:05 dist-test-slave-rwrg krb5kdc[21332](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497245, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:05.724757 21529 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:14:05.725245 21529 webserver.cc:460] Webserver started at http://127.17.183.129:37347/ using document root <none> and password file <none>
I20260812 01:14:05.725484 21529 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:05.725531 21529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:05.725697 21529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:05.726792 21529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "f6d240d01f404b1eb309764c903e2cb6"
format_stamp: "Formatted at 2026-08-12 01:14:05 on dist-test-slave-rwrg"
server_key: "e645559c4503a2cc6d0a137d830011bd"
server_key_iv: "2a680072269f2ca618de43dd6b400bfa"
server_key_version: "encryptionkey@0"
I20260812 01:14:05.727173 21529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "f6d240d01f404b1eb309764c903e2cb6"
format_stamp: "Formatted at 2026-08-12 01:14:05 on dist-test-slave-rwrg"
server_key: "e645559c4503a2cc6d0a137d830011bd"
server_key_iv: "2a680072269f2ca618de43dd6b400bfa"
server_key_version: "encryptionkey@0"
I20260812 01:14:05.728588 21529 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 01:14:05.729362 21551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:05.729535 21529 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:05.729645 21529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "f6d240d01f404b1eb309764c903e2cb6"
format_stamp: "Formatted at 2026-08-12 01:14:05 on dist-test-slave-rwrg"
server_key: "e645559c4503a2cc6d0a137d830011bd"
server_key_iv: "2a680072269f2ca618de43dd6b400bfa"
server_key_version: "encryptionkey@0"
I20260812 01:14:05.729722 21529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:05.741089 21529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:05.743391 21529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:05.743597 21529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:05.744176 21529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:05.744235 21529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:05.744266 21529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:05.744289 21529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:14:05 dist-test-slave-rwrg krb5kdc[21332](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497245, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:05.752235 21529 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:45555
I20260812 01:14:05.752351 21741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:45555 every 8 connection(s)
I20260812 01:14:05.752754 21529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:14:05.754804 21496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:05.744602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:44519 (local address 127.17.183.190:43171)
0812 01:14:05.744691 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:05.744693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:05.744902 (+ 209us) server_negotiation.cc:407] Connection header received
0812 01:14:05.745367 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:05.745369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:05.745383 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:05.745510 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:05.746091 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.746898 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.747975 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.748215 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.748293 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:05.751686 (+ 3393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:05.751687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:05.751688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:05.751696 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:05.753462 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:05.753827 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:05.753828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:05.753828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:05.753879 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:05.754194 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:05.754195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:05.754195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:05.754334 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:05.754399 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:05.754657 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 01:14:05.754728 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 01:14:05.754956 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:05.744569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43171 (local address 127.17.183.129:44519)
0812 01:14:05.744748 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:05.744785 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:05.745252 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:05.745602 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:05.745606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:05.745820 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:05.745991 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:05.745994 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.746995 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.746996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:05.747879 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:05.747881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.748314 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.748315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:05.748432 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:05.749009 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:05.749020 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:05.751580 (+ 2560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:05.753536 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:05.753540 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:05.753542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:05.753757 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:05.753939 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:05.753939 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:05.753940 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:05.754034 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:05.754401 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:05.754406 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:05.754510 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 01:14:05.754605 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 01:14:05.754739 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":100,"threads_started":1}
I20260812 01:14:05.755523 21742 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43171
I20260812 01:14:05.755606 21742 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:05.755807 21742 heartbeater.cc:511] Master 127.17.183.190:43171 requested a full tablet report, sending...
I20260812 01:14:05.756361 21411 ts_manager.cc:194] Registered new tserver with Master: f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129:45555)
I20260812 01:14:05.757057 21411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:44519
I20260812 01:14:05.760891 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 21529
I20260812 01:14:05.761000 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:05.761197 18142 external_mini_cluster.cc:1428] Setting key cc6f7fb66f2988e647203957a92a3b97
I20260812 01:14:05.762213 21496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:05.756534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:40757 (local address 127.17.183.190:43171)
0812 01:14:05.756574 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:05.756578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:05.756766 (+ 188us) server_negotiation.cc:407] Connection header received
0812 01:14:05.756835 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:05.756836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:05.756846 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:05.756909 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:05.757216 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.757759 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.758457 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.758665 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.758738 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:05.759617 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:05.759618 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:05.759619 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:05.759625 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:05.760973 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:05.761376 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:05.761377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:05.761378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:05.761455 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:05.761666 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:05.761667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:05.761667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:05.761823 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:05.761901 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:05.762048 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 01:14:05.762134 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:14:05.762214 21748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:05.756578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43171 (local address 127.17.183.129:40757)
0812 01:14:05.756696 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:05.756706 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:05.756779 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:05.756913 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:05.756914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:05.757084 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:05.757159 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:05.757161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.757858 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.757859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:05.758373 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:05.758374 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.758749 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.758750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:05.758830 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:05.759254 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:05.759259 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:05.759517 (+ 258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:05.761072 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:05.761073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:05.761073 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:05.761292 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:05.761526 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:05.761527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:05.761528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:05.761608 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:05.761906 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:05.761907 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:05.761943 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 01:14:05.762018 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 01:14:05.762120 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:14:05.787608 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43171
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:05.871670 21751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:05.871942 21751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:05.871987 21751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:05.873119 21751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:05.873157 21751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:05.873178 21751 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 01:14:05.873189 21751 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:14:05.873205 21751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:05.874583 21751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.183.190:43171
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:05.874770 21751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:05.874943 21751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:05.879947 21760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:05.880100 21764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:05.880123 21762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:05.880182 21751 server_base.cc:1034] running on GCE node
I20260812 01:14:05.880435 21751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:05.880726 21751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:05.881867 21751 hybrid_clock.cc:648] HybridClock initialized: now 1786497245881857 us; error 27 us; skew 500 ppm
Aug 12 01:14:05 dist-test-slave-rwrg krb5kdc[21332](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497245, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:05.884315 21751 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:14:05.884833 21751 webserver.cc:460] Webserver started at http://127.17.183.130:40923/ using document root <none> and password file <none>
I20260812 01:14:05.885051 21751 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:05.885094 21751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:05.885249 21751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:05.886335 21751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "6f250d40a0234fad8163a55445bf85d2"
format_stamp: "Formatted at 2026-08-12 01:14:05 on dist-test-slave-rwrg"
server_key: "d59f62744d86d1d2a79231ff937a9c74"
server_key_iv: "a8a862a65dacde1e20427c34de1d6a8d"
server_key_version: "encryptionkey@0"
I20260812 01:14:05.886708 21751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "6f250d40a0234fad8163a55445bf85d2"
format_stamp: "Formatted at 2026-08-12 01:14:05 on dist-test-slave-rwrg"
server_key: "d59f62744d86d1d2a79231ff937a9c74"
server_key_iv: "a8a862a65dacde1e20427c34de1d6a8d"
server_key_version: "encryptionkey@0"
I20260812 01:14:05.888044 21751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:05.888845 21783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:05.889041 21751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:05.889134 21751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "6f250d40a0234fad8163a55445bf85d2"
format_stamp: "Formatted at 2026-08-12 01:14:05 on dist-test-slave-rwrg"
server_key: "d59f62744d86d1d2a79231ff937a9c74"
server_key_iv: "a8a862a65dacde1e20427c34de1d6a8d"
server_key_version: "encryptionkey@0"
I20260812 01:14:05.889209 21751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:05.905493 21751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:05.907567 21751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:05.907737 21751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:05.908397 21751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:05.908452 21751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:05.908484 21751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:05.908527 21751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:14:05 dist-test-slave-rwrg krb5kdc[21332](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497245, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:05.916738 21751 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:33665
I20260812 01:14:05.916853 21983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:33665 every 8 connection(s)
I20260812 01:14:05.917176 21751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:05.918953 21496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:05.908919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:58301 (local address 127.17.183.190:43171)
0812 01:14:05.908986 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:05.908989 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:05.909316 (+ 327us) server_negotiation.cc:407] Connection header received
0812 01:14:05.910164 (+ 848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:05.910166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:05.910179 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:05.910239 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:05.911190 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.911699 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.913440 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.913679 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.913767 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:05.916022 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:05.916024 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:05.916025 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:05.916034 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:05.917805 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:05.918174 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:05.918176 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:05.918176 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:05.918228 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:05.918443 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:05.918444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:05.918444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:05.918546 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:05.918596 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:05.918826 (+ 230us) server_negotiation.cc:299] Negotiation successful
0812 01:14:05.918888 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 01:14:05.919155 21796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:05.908923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43171 (local address 127.17.183.130:58301)
0812 01:14:05.909131 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:05.909189 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:05.910005 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:05.910334 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:05.910339 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:05.910762 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:05.911079 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:05.911087 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.911815 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.911816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:05.913338 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:05.913343 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.913789 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.913790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:05.913956 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:05.914513 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:05.914521 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:05.915941 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:05.917881 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:05.917886 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:05.917887 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:05.918105 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:05.918289 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:05.918290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:05.918290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:05.918387 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:05.918603 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:05.918607 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:05.918717 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 01:14:05.918798 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 01:14:05.918913 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":114,"threads_started":1}
I20260812 01:14:05.919674 21986 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43171
I20260812 01:14:05.919766 21986 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:05.919974 21986 heartbeater.cc:511] Master 127.17.183.190:43171 requested a full tablet report, sending...
I20260812 01:14:05.920341 21412 ts_manager.cc:194] Registered new tserver with Master: 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665)
I20260812 01:14:05.920864 21412 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:58301
I20260812 01:14:05.922694 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 21751
I20260812 01:14:05.922811 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:05.923002 18142 external_mini_cluster.cc:1428] Setting key ffb5485e67acfbf88db81bd5b950b65e
I20260812 01:14:05.926234 21496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:05.920776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:48505 (local address 127.17.183.190:43171)
0812 01:14:05.920818 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:05.920820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:05.920901 (+ 81us) server_negotiation.cc:407] Connection header received
0812 01:14:05.920976 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:05.920977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:05.920988 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:05.921047 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:05.921374 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.921833 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.922555 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.922757 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.922842 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:05.923780 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:05.923782 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:05.923782 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:05.923788 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:05.925088 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:05.925457 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:05.925459 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:05.925459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:05.925546 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:05.925759 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:05.925760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:05.925760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:05.925908 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:05.925959 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:05.926117 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 01:14:05.926175 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:14:05.926353 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:05.920690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43171 (local address 127.17.183.130:48505)
0812 01:14:05.920831 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:05.920842 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:05.920909 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:05.921052 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:05.921052 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:05.921222 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:05.921286 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:05.921287 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.921935 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.921936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:05.922441 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:05.922443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:05.922856 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:05.922857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:05.922938 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:05.923389 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:05.923394 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:05.923671 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:05.925169 (+ 1498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:05.925169 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:05.925170 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:05.925392 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:05.925629 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:05.925630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:05.925630 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:05.925697 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:05.925971 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:05.925972 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:05.926023 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 01:14:05.926101 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 01:14:05.926215 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":7,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:14:05.950819 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43171
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:06.035869 21997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:06.036087 21997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:06.036114 21997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:06.037379 21997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:06.037420 21997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:06.037441 21997 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 01:14:06.037490 21997 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:14:06.037515 21997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:06.039191 21997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.183.190:43171
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:06.039444 21997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:06.039691 21997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:06.044850 22009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:06.044878 22006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:06.044876 22007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:06.045063 21997 server_base.cc:1034] running on GCE node
I20260812 01:14:06.045337 21997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:06.045585 21997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:06.046751 21997 hybrid_clock.cc:648] HybridClock initialized: now 1786497246046747 us; error 39 us; skew 500 ppm
Aug 12 01:14:06 dist-test-slave-rwrg krb5kdc[21332](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497246, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:06.049222 21997 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:14:06.049736 21997 webserver.cc:460] Webserver started at http://127.17.183.131:41461/ using document root <none> and password file <none>
I20260812 01:14:06.049988 21997 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:06.050034 21997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:06.050185 21997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:06.051270 21997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "b4ba11e4acd84664af189b744b3e69b2"
format_stamp: "Formatted at 2026-08-12 01:14:06 on dist-test-slave-rwrg"
server_key: "04920d6e332336fdd3cf552657848852"
server_key_iv: "62f586ae73abbcab81d04f83d54e9ca7"
server_key_version: "encryptionkey@0"
I20260812 01:14:06.051641 21997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "b4ba11e4acd84664af189b744b3e69b2"
format_stamp: "Formatted at 2026-08-12 01:14:06 on dist-test-slave-rwrg"
server_key: "04920d6e332336fdd3cf552657848852"
server_key_iv: "62f586ae73abbcab81d04f83d54e9ca7"
server_key_version: "encryptionkey@0"
I20260812 01:14:06.053061 21997 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 01:14:06.053813 22020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:06.053987 21997 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:06.054080 21997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "b4ba11e4acd84664af189b744b3e69b2"
format_stamp: "Formatted at 2026-08-12 01:14:06 on dist-test-slave-rwrg"
server_key: "04920d6e332336fdd3cf552657848852"
server_key_iv: "62f586ae73abbcab81d04f83d54e9ca7"
server_key_version: "encryptionkey@0"
I20260812 01:14:06.054165 21997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:06.068274 21997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:06.070218 21997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:06.070392 21997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:06.070962 21997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:06.071022 21997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:06.071062 21997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:06.071095 21997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:14:06 dist-test-slave-rwrg krb5kdc[21332](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497246, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:06.079270 21997 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:34779
I20260812 01:14:06.079334 22256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:34779 every 8 connection(s)
I20260812 01:14:06.079718 21997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:06.081732 21496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.071390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:45707 (local address 127.17.183.190:43171)
0812 01:14:06.071468 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.071472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.071696 (+ 224us) server_negotiation.cc:407] Connection header received
0812 01:14:06.072182 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.072184 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.072216 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.072303 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:06.072976 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.073503 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.074646 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.074862 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.074943 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.078671 (+ 3728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:06.078673 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:06.078673 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:06.078681 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:06.080451 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:06.080958 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:06.080959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:06.080960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:06.081016 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:06.081242 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:06.081243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:06.081243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:06.081349 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:06.081412 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.081602 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.081671 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 01:14:06.081898 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.071379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43171 (local address 127.17.183.131:45707)
0812 01:14:06.071551 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.071592 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.072085 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.072356 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.072360 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.072669 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:06.072868 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.072874 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.073605 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.073607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.074546 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.074549 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.074954 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.074955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.075122 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.075667 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:06.075678 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:06.078540 (+ 2862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:06.080615 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:06.080622 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:06.080625 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:06.080887 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:06.081092 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:06.081093 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:06.081093 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:06.081186 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:06.081401 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:06.081404 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:06.081506 (+ 102us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.081587 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.081702 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260812 01:14:06.082401 22257 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43171
I20260812 01:14:06.082487 22257 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:06.082691 22257 heartbeater.cc:511] Master 127.17.183.190:43171 requested a full tablet report, sending...
I20260812 01:14:06.083094 21412 ts_manager.cc:194] Registered new tserver with Master: b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131:34779)
I20260812 01:14:06.083540 21412 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:45707
I20260812 01:14:06.086098 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 21997
I20260812 01:14:06.086195 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:06.086429 18142 external_mini_cluster.cc:1428] Setting key 2eb8274419091cd7f9e57f0c7daea278
I20260812 01:14:06.087634 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:14:06.089360 22269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.083500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43171 (local address 127.17.183.131:37973)
0812 01:14:06.083709 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.083743 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.083808 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.083975 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.083976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.084140 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:06.084210 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.084211 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.084960 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.084961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.085483 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.085485 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.085785 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.085786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.085839 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.086310 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:06.086316 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:06.086680 (+ 364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:06.088335 (+ 1655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:06.088335 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:06.088336 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:06.088548 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:06.088746 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:06.088747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:06.088747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:06.088804 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:06.089093 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:06.089094 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:06.089131 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.089186 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.089271 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":139,"threads_started":1}
I20260812 01:14:06.089478 21496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.083554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:37973 (local address 127.17.183.190:43171)
0812 01:14:06.083622 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.083624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.083793 (+ 169us) server_negotiation.cc:407] Connection header received
0812 01:14:06.083866 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.083866 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.083887 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.083971 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:06.084292 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.084876 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.085553 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.085720 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.085769 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.086797 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:06.086798 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:06.086798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:06.086805 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:06.088236 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:06.088617 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:06.088618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:06.088618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:06.088678 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:06.088869 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:06.088869 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:06.088870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:06.089018 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:06.089086 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.089231 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.089343 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 12 01:14:06 dist-test-slave-rwrg krb5kdc[21332](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 01:14:06 dist-test-slave-rwrg krb5kdc[21332](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:06.111178 21496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.104723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48446 (local address 127.17.183.190:43171)
0812 01:14:06.104759 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.104761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.104786 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:14:06.104866 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.104867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.104876 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.104918 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:06.105431 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.105889 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.106574 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.106757 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.106804 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.108982 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:06.108983 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:06.108983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:06.108989 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:06.110252 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:06.110618 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:06.110618 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:06.110619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:06.110667 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:06.110826 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:06.110827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:06.110827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:06.110916 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:06.110987 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.111068 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.111120 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 01:14:06.112911 21412 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48446:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:06.114480 21412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:06.121165 22290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.116936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:33665 (local address 127.0.0.1:42218)
0812 01:14:06.117176 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.117187 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.117243 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.117638 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.117641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.117644 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:06.117711 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.117713 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.118643 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.118644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.119858 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.119861 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.120873 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.120874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.120954 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.120967 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.121038 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.121088 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":97,"threads_started":1}
I20260812 01:14:06.121188 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.117194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42218 (local address 127.17.183.130:33665)
0812 01:14:06.117401 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.117405 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.117414 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:06.117447 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.117449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.117462 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.117557 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:06.117796 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.118551 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.119942 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.120792 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.120876 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.120935 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.121059 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.121095 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":101,"threads_started":1}
I20260812 01:14:06.121402 22293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.117114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:34779 (local address 127.0.0.1:37914)
0812 01:14:06.117515 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.117527 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.117585 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.117827 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.117828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.117830 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:06.117884 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.117886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.119131 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.119132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.120144 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.120146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.121162 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.121164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.121228 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.121233 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.121284 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.121334 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":12,"thread_start_us":72,"threads_started":1}
I20260812 01:14:06.121678 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.117320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37914 (local address 127.17.183.131:34779)
0812 01:14:06.117524 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.117530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.117571 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:14:06.117660 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.117662 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.117677 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.117760 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:06.117964 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.119035 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.120234 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.121000 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.121074 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.121124 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.121506 (+ 382us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.121554 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":106,"threads_started":1}
I20260812 01:14:06.121915 22291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.116911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45555 (local address 127.0.0.1:54790)
0812 01:14:06.117111 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.117156 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.117221 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.117869 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.117870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.117872 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:06.117909 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.117911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.119182 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.119183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.120297 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.120300 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.121699 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.121701 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.121761 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.121764 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.121813 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.121847 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":20,"thread_start_us":60,"threads_started":1}
I20260812 01:14:06.121958 21874 tablet_service.cc:1467] Processing CreateTablet for tablet b2ea0e5cadb54392ac0d3d961502d8e1 (DEFAULT_TABLE table=test-table [id=ceb6e4b80d4f498f84e7f94db492fc91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:06.122257 22292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.117007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54790 (local address 127.17.183.129:45555)
0812 01:14:06.117714 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.117718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.117727 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:06.117776 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.117778 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.117792 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.117872 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:06.117975 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.119081 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.120401 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.121182 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.121684 (+ 502us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.121895 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.121924 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.122107 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":77,"threads_started":1}
I20260812 01:14:06.122315 21874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2ea0e5cadb54392ac0d3d961502d8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:06.122262 22123 tablet_service.cc:1467] Processing CreateTablet for tablet b2ea0e5cadb54392ac0d3d961502d8e1 (DEFAULT_TABLE table=test-table [id=ceb6e4b80d4f498f84e7f94db492fc91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:06.122648 22123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2ea0e5cadb54392ac0d3d961502d8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:06.123008 21639 tablet_service.cc:1467] Processing CreateTablet for tablet b2ea0e5cadb54392ac0d3d961502d8e1 (DEFAULT_TABLE table=test-table [id=ceb6e4b80d4f498f84e7f94db492fc91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:06.123348 21639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2ea0e5cadb54392ac0d3d961502d8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:06.125419 22299 tablet_bootstrap.cc:492] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: Bootstrap starting.
I20260812 01:14:06.126343 22301 tablet_bootstrap.cc:492] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: Bootstrap starting.
I20260812 01:14:06.126405 22299 tablet_bootstrap.cc:654] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:06.126839 22299 log.cc:824] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:06.127019 22301 tablet_bootstrap.cc:654] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:06.127275 22304 tablet_bootstrap.cc:492] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: Bootstrap starting.
I20260812 01:14:06.127364 22301 log.cc:824] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:06.127835 22299 tablet_bootstrap.cc:492] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: No bootstrap required, opened a new log
I20260812 01:14:06.127939 22299 ts_tablet_manager.cc:1397] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 01:14:06.128142 22304 tablet_bootstrap.cc:654] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:06.128191 22301 tablet_bootstrap.cc:492] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: No bootstrap required, opened a new log
I20260812 01:14:06.128260 22301 ts_tablet_manager.cc:1397] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:14:06.128476 22304 log.cc:824] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:06.129186 22304 tablet_bootstrap.cc:492] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: No bootstrap required, opened a new log
I20260812 01:14:06.129282 22304 ts_tablet_manager.cc:1397] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 01:14:06.130111 22299 raft_consensus.cc:348] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.130303 22299 raft_consensus.cc:374] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:06.130348 22299 raft_consensus.cc:729] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4ba11e4acd84664af189b744b3e69b2, State: Initialized, Role: FOLLOWER
I20260812 01:14:06.130309 22301 raft_consensus.cc:348] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.130456 22301 raft_consensus.cc:374] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:06.130496 22301 raft_consensus.cc:729] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f250d40a0234fad8163a55445bf85d2, State: Initialized, Role: FOLLOWER
I20260812 01:14:06.130476 22299 consensus_queue.cc:260] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.130601 22301 consensus_queue.cc:260] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.130745 22299 ts_tablet_manager.cc:1428] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:14:06.130865 22257 heartbeater.cc:503] Master 127.17.183.190:43171 was elected leader, sending a full tablet report...
I20260812 01:14:06.130887 22301 ts_tablet_manager.cc:1428] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:14:06.130931 22304 raft_consensus.cc:348] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.131037 21986 heartbeater.cc:503] Master 127.17.183.190:43171 was elected leader, sending a full tablet report...
I20260812 01:14:06.131090 22304 raft_consensus.cc:374] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:06.131135 22304 raft_consensus.cc:729] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d240d01f404b1eb309764c903e2cb6, State: Initialized, Role: FOLLOWER
I20260812 01:14:06.131273 22304 consensus_queue.cc:260] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.131529 22304 ts_tablet_manager.cc:1428] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 01:14:06.131592 21742 heartbeater.cc:503] Master 127.17.183.190:43171 was elected leader, sending a full tablet report...
W20260812 01:14:06.167812 21987 tablet.cc:2369] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:14:06.253639 21743 tablet.cc:2369] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:14:06.305150 22310 raft_consensus.cc:482] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:06.305276 22310 raft_consensus.cc:504] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.305634 22310 leader_election.cc:288] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665), b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131:34779)
I20260812 01:14:06.309840 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.305962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:56103 (local address 127.17.183.131:34779)
0812 01:14:06.306063 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.306066 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.306153 (+ 87us) server_negotiation.cc:407] Connection header received
0812 01:14:06.306244 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.306245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.306255 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.306313 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:06.306538 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.307281 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.308876 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.309462 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.309542 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.309551 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.309716 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.309769 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 01:14:06.309834 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.306014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:51727 (local address 127.17.183.130:33665)
0812 01:14:06.306092 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.306094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.306152 (+ 58us) server_negotiation.cc:407] Connection header received
0812 01:14:06.306237 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.306238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.306251 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.306313 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:06.306537 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.307271 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.308876 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.309463 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.309542 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.309551 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.309716 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.309758 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 01:14:06.309877 22317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.305868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:34779 (local address 127.17.183.129:56103)
0812 01:14:06.306080 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.306091 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.306152 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.306332 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.306333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.306335 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:06.306427 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.306429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.307359 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.307360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.308783 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.308787 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.309553 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.309553 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.309631 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.309637 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.309697 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.309758 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":107,"thread_start_us":59,"threads_started":1}
I20260812 01:14:06.309877 22313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.305852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:33665 (local address 127.17.183.129:51727)
0812 01:14:06.306060 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.306073 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.306152 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.306332 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.306333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.306338 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:06.306443 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.306445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.307358 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.307359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.308783 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.308787 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.309551 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.309552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.309633 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.309635 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.309697 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.309775 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":102,"thread_start_us":71,"threads_started":1}
I20260812 01:14:06.310290 21906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2ea0e5cadb54392ac0d3d961502d8e1" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f250d40a0234fad8163a55445bf85d2" is_pre_election: true
I20260812 01:14:06.310290 22163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2ea0e5cadb54392ac0d3d961502d8e1" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ba11e4acd84664af189b744b3e69b2" is_pre_election: true
I20260812 01:14:06.310452 21906 raft_consensus.cc:2454] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 0.
I20260812 01:14:06.310452 22163 raft_consensus.cc:2454] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 0.
I20260812 01:14:06.310720 21559 leader_election.cc:302] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f250d40a0234fad8163a55445bf85d2, f6d240d01f404b1eb309764c903e2cb6; no voters:
I20260812 01:14:06.310946 22310 raft_consensus.cc:2781] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:06.311031 22310 raft_consensus.cc:482] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:06.311079 22310 raft_consensus.cc:3037] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:06.311826 22310 raft_consensus.cc:504] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.311990 22310 leader_election.cc:288] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665), b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131:34779)
I20260812 01:14:06.312140 21906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2ea0e5cadb54392ac0d3d961502d8e1" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f250d40a0234fad8163a55445bf85d2"
I20260812 01:14:06.312158 22163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2ea0e5cadb54392ac0d3d961502d8e1" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ba11e4acd84664af189b744b3e69b2"
I20260812 01:14:06.312238 21906 raft_consensus.cc:3037] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:06.312227 22163 raft_consensus.cc:3037] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:06.313037 21906 raft_consensus.cc:2454] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 1.
I20260812 01:14:06.313218 21559 leader_election.cc:302] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f250d40a0234fad8163a55445bf85d2, f6d240d01f404b1eb309764c903e2cb6; no voters:
I20260812 01:14:06.313361 22310 raft_consensus.cc:2781] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:06.313455 22163 raft_consensus.cc:2454] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 1.
I20260812 01:14:06.313588 22310 raft_consensus.cc:686] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 1 LEADER]: Becoming Leader. State: Replica: f6d240d01f404b1eb309764c903e2cb6, State: Running, Role: LEADER
I20260812 01:14:06.313704 22310 consensus_queue.cc:237] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.314663 21411 catalog_manager.cc:5495] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129). New cstate: current_term: 1 leader_uuid: "f6d240d01f404b1eb309764c903e2cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
W20260812 01:14:06.330299 22258 tablet.cc:2369] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 01:14:06 dist-test-slave-rwrg krb5kdc[21332](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497245, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:06.376060 21496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.369331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48458 (local address 127.17.183.190:43171)
0812 01:14:06.369404 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.369407 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.369541 (+ 134us) server_negotiation.cc:407] Connection header received
0812 01:14:06.369644 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.369645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.369655 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.369725 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:06.370193 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.370680 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.371409 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.371595 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.371674 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.373677 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:06.373678 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:06.373678 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:06.373686 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:06.374840 (+ 1154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:06.375209 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:06.375210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:06.375211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:06.375268 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:06.375471 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:06.375472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:06.375472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:06.375580 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:06.375652 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.375830 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.375946 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":45}
I20260812 01:14:06.376127 22331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.369275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43171 (local address 127.0.0.1:48458)
0812 01:14:06.369458 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.369469 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.369557 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.369733 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.369733 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.370056 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:06.370102 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.370104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.370789 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.370790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.371320 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.371321 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.371672 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.371673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.371725 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.372221 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:06.372225 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:06.373581 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:06.374937 (+ 1356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:06.374945 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:06.374947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:06.375134 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:06.375337 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:06.375338 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:06.375338 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:06.375400 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:06.375654 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:06.375663 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:06.375710 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.375807 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.376004 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":97,"thread_start_us":78,"threads_started":1}
I20260812 01:14:06.378082 21411 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:48458:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 01:14:06.378297 21411 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:06.379837 22123 tablet_service.cc:1467] Processing CreateTablet for tablet 8e8c21bdcd4b4b118039b4f719e15652 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f70f965ad1aa4d0390f1261085c68728]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:14:06.379838 21874 tablet_service.cc:1467] Processing CreateTablet for tablet 8e8c21bdcd4b4b118039b4f719e15652 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f70f965ad1aa4d0390f1261085c68728]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:14:06.379863 21639 tablet_service.cc:1467] Processing CreateTablet for tablet 8e8c21bdcd4b4b118039b4f719e15652 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f70f965ad1aa4d0390f1261085c68728]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:14:06.380021 21874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e8c21bdcd4b4b118039b4f719e15652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:06.380021 21639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e8c21bdcd4b4b118039b4f719e15652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:06.380021 22123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e8c21bdcd4b4b118039b4f719e15652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:06.381567 22299 tablet_bootstrap.cc:492] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: Bootstrap starting.
I20260812 01:14:06.381636 22301 tablet_bootstrap.cc:492] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2: Bootstrap starting.
I20260812 01:14:06.382103 22299 tablet_bootstrap.cc:654] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:06.382321 22301 tablet_bootstrap.cc:654] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:06.382752 22304 tablet_bootstrap.cc:492] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6: Bootstrap starting.
I20260812 01:14:06.382849 22299 tablet_bootstrap.cc:492] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: No bootstrap required, opened a new log
I20260812 01:14:06.382920 22299 ts_tablet_manager.cc:1397] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:06.383065 22301 tablet_bootstrap.cc:492] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2: No bootstrap required, opened a new log
I20260812 01:14:06.383107 22301 ts_tablet_manager.cc:1397] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:06.383091 22299 raft_consensus.cc:348] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.383184 22299 raft_consensus.cc:374] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:06.383211 22299 raft_consensus.cc:729] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4ba11e4acd84664af189b744b3e69b2, State: Initialized, Role: FOLLOWER
I20260812 01:14:06.383226 22304 tablet_bootstrap.cc:654] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:06.383260 22299 consensus_queue.cc:260] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.383268 22301 raft_consensus.cc:348] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.383340 22301 raft_consensus.cc:374] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:06.383361 22301 raft_consensus.cc:729] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f250d40a0234fad8163a55445bf85d2, State: Initialized, Role: FOLLOWER
I20260812 01:14:06.383361 22299 ts_tablet_manager.cc:1428] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:06.383409 22301 consensus_queue.cc:260] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.383504 22301 ts_tablet_manager.cc:1428] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:06.383445 22307 tablet_replica.cc:439] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } } }
I20260812 01:14:06.383555 22307 tablet_replica.cc:442] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:06.383657 22308 tablet_replica.cc:439] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } } }
I20260812 01:14:06.383749 22308 tablet_replica.cc:442] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:06.384559 22304 tablet_bootstrap.cc:492] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6: No bootstrap required, opened a new log
I20260812 01:14:06.384614 22304 ts_tablet_manager.cc:1397] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 01:14:06.384778 22304 raft_consensus.cc:348] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.384836 22304 raft_consensus.cc:374] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:06.384850 22304 raft_consensus.cc:729] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d240d01f404b1eb309764c903e2cb6, State: Initialized, Role: FOLLOWER
I20260812 01:14:06.384992 22304 consensus_queue.cc:260] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.385161 22304 ts_tablet_manager.cc:1428] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:06.385282 22310 tablet_replica.cc:439] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } } }
I20260812 01:14:06.385376 22310 tablet_replica.cc:442] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:06.513733 22307 raft_consensus.cc:482] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:06.513839 22307 raft_consensus.cc:504] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.514209 22307 leader_election.cc:288] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129:45555), 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665)
I20260812 01:14:06.517050 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.514482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:38699 (local address 127.17.183.130:33665)
0812 01:14:06.514539 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.514542 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.514550 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:06.514602 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.514603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.514611 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.514683 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:06.514855 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.515347 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.516278 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.516693 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.516772 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.516782 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.516953 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.516992 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 01:14:06.517045 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.514382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:33665 (local address 127.17.183.131:38699)
0812 01:14:06.514442 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.514454 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.514500 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.514691 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.514692 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.514694 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:06.514779 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.514781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.515437 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.515438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.516180 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.516182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.516782 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.516783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.516868 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.516871 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.516932 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.516971 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 01:14:06.517239 22292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.514495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:34991 (local address 127.17.183.129:45555)
0812 01:14:06.514585 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.514587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.514663 (+ 76us) server_negotiation.cc:407] Connection header received
0812 01:14:06.514788 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.514789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.514797 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.514858 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:06.515022 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.515485 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.516403 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.516840 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.516930 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.516939 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.517095 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.517142 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:14:06.517299 21906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e8c21bdcd4b4b118039b4f719e15652" candidate_uuid: "b4ba11e4acd84664af189b744b3e69b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f250d40a0234fad8163a55445bf85d2" is_pre_election: true
I20260812 01:14:06.517390 21906 raft_consensus.cc:2454] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4ba11e4acd84664af189b744b3e69b2 in term 0.
I20260812 01:14:06.517453 22340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.514392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45555 (local address 127.17.183.131:34991)
0812 01:14:06.514572 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.514584 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.514681 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.514863 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.514864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.514866 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:06.514944 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.514946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.515570 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.515571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.516305 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.516307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.516949 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.516950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.517019 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.517023 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.517091 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.517283 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":114,"threads_started":1}
I20260812 01:14:06.517593 22029 leader_election.cc:302] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f250d40a0234fad8163a55445bf85d2, b4ba11e4acd84664af189b744b3e69b2; no voters:
I20260812 01:14:06.517765 22307 raft_consensus.cc:2781] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:06.517812 22307 raft_consensus.cc:482] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:06.517833 22307 raft_consensus.cc:3037] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:06.517792 21667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e8c21bdcd4b4b118039b4f719e15652" candidate_uuid: "b4ba11e4acd84664af189b744b3e69b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d240d01f404b1eb309764c903e2cb6" is_pre_election: true
I20260812 01:14:06.517903 21667 raft_consensus.cc:2454] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4ba11e4acd84664af189b744b3e69b2 in term 0.
I20260812 01:14:06.518621 22307 raft_consensus.cc:504] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.518764 22307 leader_election.cc:288] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [CANDIDATE]: Term 1 election: Requested vote from peers f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129:45555), 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665)
I20260812 01:14:06.518911 21906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e8c21bdcd4b4b118039b4f719e15652" candidate_uuid: "b4ba11e4acd84664af189b744b3e69b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f250d40a0234fad8163a55445bf85d2"
I20260812 01:14:06.518920 21667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e8c21bdcd4b4b118039b4f719e15652" candidate_uuid: "b4ba11e4acd84664af189b744b3e69b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d240d01f404b1eb309764c903e2cb6"
I20260812 01:14:06.519009 21906 raft_consensus.cc:3037] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:06.519029 21667 raft_consensus.cc:3037] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:06.519755 21906 raft_consensus.cc:2454] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4ba11e4acd84664af189b744b3e69b2 in term 1.
I20260812 01:14:06.519785 21667 raft_consensus.cc:2454] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4ba11e4acd84664af189b744b3e69b2 in term 1.
I20260812 01:14:06.519953 22022 leader_election.cc:302] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4ba11e4acd84664af189b744b3e69b2, f6d240d01f404b1eb309764c903e2cb6; no voters:
I20260812 01:14:06.520099 22307 raft_consensus.cc:2781] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:06.520291 22307 raft_consensus.cc:686] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [term 1 LEADER]: Becoming Leader. State: Replica: b4ba11e4acd84664af189b744b3e69b2, State: Running, Role: LEADER
I20260812 01:14:06.520398 22307 consensus_queue.cc:237] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.520905 22342 tablet_replica.cc:439] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: TxnStatusTablet state changed. Reason: New leader b4ba11e4acd84664af189b744b3e69b2. Latest consensus state: current_term: 1 leader_uuid: "b4ba11e4acd84664af189b744b3e69b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } } }
I20260812 01:14:06.520993 22342 tablet_replica.cc:442] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:14:06.521186 22344 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 01:14:06.521335 22344 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 01:14:06.521293 21411 catalog_manager.cc:5495] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131). New cstate: current_term: 1 leader_uuid: "b4ba11e4acd84664af189b744b3e69b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } health_report { overall_health: HEALTHY } } }
I20260812 01:14:06.530206 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.527190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37928 (local address 127.17.183.131:34779)
0812 01:14:06.527227 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.527229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.527240 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:14:06.527292 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.527293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.527310 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.527376 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:06.527557 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.528304 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.529467 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.529647 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.529705 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.529908 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:06.529996 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:06.530053 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.530143 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.530160 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:14:06.530265 22331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.527059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:34779 (local address 127.0.0.1:37928)
0812 01:14:06.527130 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.527144 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.527207 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.527428 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.527429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.527430 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:14:06.527477 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.527480 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.528402 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.528403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.529375 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.529379 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.529727 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.529728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.529797 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.529814 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:14:06.530064 (+ 250us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:14:06.530074 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.530140 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.530190 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 01:14:06.531970 21667 raft_consensus.cc:1261] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Refusing update from remote peer b4ba11e4acd84664af189b744b3e69b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:06.531971 21906 raft_consensus.cc:1261] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Refusing update from remote peer b4ba11e4acd84664af189b744b3e69b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:06.532275 22342 consensus_queue.cc:1035] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:06.532431 22307 consensus_queue.cc:1035] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:06.533658 22310 tablet_replica.cc:439] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6: TxnStatusTablet state changed. Reason: New leader b4ba11e4acd84664af189b744b3e69b2. Latest consensus state: current_term: 1 leader_uuid: "b4ba11e4acd84664af189b744b3e69b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } } }
I20260812 01:14:06.533660 22308 tablet_replica.cc:439] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2: TxnStatusTablet state changed. Reason: New leader b4ba11e4acd84664af189b744b3e69b2. Latest consensus state: current_term: 1 leader_uuid: "b4ba11e4acd84664af189b744b3e69b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } } }
I20260812 01:14:06.533764 22308 tablet_replica.cc:442] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:06.533784 22310 tablet_replica.cc:442] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:06.535254 22307 tablet_replica.cc:439] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b4ba11e4acd84664af189b744b3e69b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } } }
I20260812 01:14:06.535344 22307 tablet_replica.cc:442] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:14:06.535389 22307 tablet_replica.cc:439] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b4ba11e4acd84664af189b744b3e69b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } } }
I20260812 01:14:06.535449 22307 tablet_replica.cc:442] T 8e8c21bdcd4b4b118039b4f719e15652 P b4ba11e4acd84664af189b744b3e69b2: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:14:06.535581 22308 tablet_replica.cc:439] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b4ba11e4acd84664af189b744b3e69b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } } }
I20260812 01:14:06.535625 22351 mvcc.cc:205] Tried to move back new op lower bound from 7317492721792397312 to 7317492721748418560. Current Snapshot: MvccSnapshot[applied={T|T < 7317492721792397312}]
I20260812 01:14:06.535619 22310 tablet_replica.cc:439] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b4ba11e4acd84664af189b744b3e69b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } } }
I20260812 01:14:06.535669 22308 tablet_replica.cc:442] T 8e8c21bdcd4b4b118039b4f719e15652 P 6f250d40a0234fad8163a55445bf85d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:06.535693 22310 tablet_replica.cc:442] T 8e8c21bdcd4b4b118039b4f719e15652 P f6d240d01f404b1eb309764c903e2cb6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:06.535825 22354 mvcc.cc:205] Tried to move back new op lower bound from 7317492721792397312 to 7317492721748418560. Current Snapshot: MvccSnapshot[applied={T|T < 7317492721792397312}]
I20260812 01:14:06.536383 22355 mvcc.cc:205] Tried to move back new op lower bound from 7317492721792397312 to 7317492721748418560. Current Snapshot: MvccSnapshot[applied={T|T < 7317492721792397312}]
I20260812 01:14:06.541034 22292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.538566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54792 (local address 127.17.183.129:45555)
0812 01:14:06.538607 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.538609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.538617 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:06.538693 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.538694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.538711 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.538802 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:06.538956 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.539421 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.540201 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.540410 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.540487 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.540688 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:06.540797 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:06.540883 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.540936 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.540956 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:14:06.549094 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.543529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:42823 (local address 127.17.183.131:34779)
0812 01:14:06.543584 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.543586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.546718 (+ 3132us) server_negotiation.cc:407] Connection header received
0812 01:14:06.546782 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.546783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.546794 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.546868 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:06.547019 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.547524 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.548335 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.548590 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.548667 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.548853 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:06.548886 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:06.548939 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.549014 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.549031 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 01:14:06.549134 22378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.543444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:34779 (local address 127.17.183.129:42823)
0812 01:14:06.546643 (+ 3199us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.546653 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.546730 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.546882 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.546883 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.546885 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:14:06.546945 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.546946 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.547601 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.547602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.548219 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.548221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.548668 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.548669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.548739 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.548754 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:14:06.548950 (+ 196us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:14:06.548951 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.549002 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.549042 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3155,"thread_start_us":69,"threads_started":1}
I20260812 01:14:06.551882 21906 raft_consensus.cc:1261] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Refusing update from remote peer f6d240d01f404b1eb309764c903e2cb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:06.551940 22163 raft_consensus.cc:1261] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Refusing update from remote peer f6d240d01f404b1eb309764c903e2cb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:06.552174 22318 consensus_queue.cc:1035] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:06.552278 22310 consensus_queue.cc:1035] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:06.561388 22292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.559027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:38643 (local address 127.17.183.129:45555)
0812 01:14:06.559069 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.559071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.559077 (+ 6us) server_negotiation.cc:407] Connection header received
0812 01:14:06.559094 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.559095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.559101 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.559144 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:06.559277 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.559680 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.560740 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.560946 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.560999 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.561190 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:06.561213 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:06.561259 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.561328 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.561344 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:14:06.561431 22269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.558836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45555 (local address 127.17.183.131:38643)
0812 01:14:06.558896 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.558907 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.558948 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.559168 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.559168 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.559170 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:14:06.559224 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.559226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.559748 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.559749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.560657 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.560660 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.561019 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.561020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.561095 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.561111 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:14:06.561268 (+ 157us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:14:06.561270 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.561327 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.561365 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 01:14:06.571039 21411 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48446:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:06.571126 21411 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48446:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:06.571892 21411 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2: Sending DeleteTablet for 3 replicas of tablet b2ea0e5cadb54392ac0d3d961502d8e1
I20260812 01:14:06.572269 22123 tablet_service.cc:1514] Processing DeleteTablet for tablet b2ea0e5cadb54392ac0d3d961502d8e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:06 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:37914
I20260812 01:14:06.572309 21874 tablet_service.cc:1514] Processing DeleteTablet for tablet b2ea0e5cadb54392ac0d3d961502d8e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:06 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:42218
I20260812 01:14:06.572314 21639 tablet_service.cc:1514] Processing DeleteTablet for tablet b2ea0e5cadb54392ac0d3d961502d8e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:06 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:54790
I20260812 01:14:06.572573 22399 tablet_replica.cc:330] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: stopping tablet replica
I20260812 01:14:06.572678 22399 raft_consensus.cc:2229] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:06.572788 22399 raft_consensus.cc:2258] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:06.572750 21411 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48446:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:06.572899 21411 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:06.573254 22399 ts_tablet_manager.cc:1905] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:06.574048 22123 tablet_service.cc:1467] Processing CreateTablet for tablet 74e366499e3141098a7b1a5593c5164f (DEFAULT_TABLE table=test-table [id=e60bc50a1efa494cb40308479c0d5510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:06.574065 21639 tablet_service.cc:1467] Processing CreateTablet for tablet 74e366499e3141098a7b1a5593c5164f (DEFAULT_TABLE table=test-table [id=e60bc50a1efa494cb40308479c0d5510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:06.574172 21639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74e366499e3141098a7b1a5593c5164f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:06.574180 22123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74e366499e3141098a7b1a5593c5164f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:06.575199 22399 ts_tablet_manager.cc:1918] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:06.575301 22399 log.cc:1196] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/b2ea0e5cadb54392ac0d3d961502d8e1
I20260812 01:14:06.575489 22304 tablet_bootstrap.cc:492] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6: Bootstrap starting.
I20260812 01:14:06.575582 22399 ts_tablet_manager.cc:1939] T b2ea0e5cadb54392ac0d3d961502d8e1 P f6d240d01f404b1eb309764c903e2cb6: Deleting consensus metadata
I20260812 01:14:06.575605 22299 tablet_bootstrap.cc:492] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2: Bootstrap starting.
I20260812 01:14:06.575973 22304 tablet_bootstrap.cc:654] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:06.576172 22299 tablet_bootstrap.cc:654] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:06.576468 21382 catalog_manager.cc:4841] TS f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129:45555): tablet b2ea0e5cadb54392ac0d3d961502d8e1 (table test-table [id=ceb6e4b80d4f498f84e7f94db492fc91]) successfully deleted
I20260812 01:14:06.576668 22304 tablet_bootstrap.cc:492] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6: No bootstrap required, opened a new log
I20260812 01:14:06.576706 22304 ts_tablet_manager.cc:1397] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:06.576797 21874 tablet_service.cc:1467] Processing CreateTablet for tablet 74e366499e3141098a7b1a5593c5164f (DEFAULT_TABLE table=test-table [id=e60bc50a1efa494cb40308479c0d5510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:06.576843 22304 raft_consensus.cc:348] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.576905 21874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74e366499e3141098a7b1a5593c5164f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:06.576907 22304 raft_consensus.cc:374] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:06.576927 22304 raft_consensus.cc:729] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d240d01f404b1eb309764c903e2cb6, State: Initialized, Role: FOLLOWER
I20260812 01:14:06.576973 22304 consensus_queue.cc:260] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.577064 22304 ts_tablet_manager.cc:1428] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:06.578238 22301 tablet_bootstrap.cc:492] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2: Bootstrap starting.
I20260812 01:14:06.578687 22301 tablet_bootstrap.cc:654] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:06.579413 22301 tablet_bootstrap.cc:492] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2: No bootstrap required, opened a new log
I20260812 01:14:06.579469 22301 ts_tablet_manager.cc:1397] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:06.579617 22301 raft_consensus.cc:348] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.579710 22301 raft_consensus.cc:374] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:06.579734 22301 raft_consensus.cc:729] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f250d40a0234fad8163a55445bf85d2, State: Initialized, Role: FOLLOWER
I20260812 01:14:06.579775 22301 consensus_queue.cc:260] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.579873 22301 ts_tablet_manager.cc:1428] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:06.580596 22398 tablet_replica.cc:330] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: stopping tablet replica
I20260812 01:14:06.580770 22396 tablet_replica.cc:330] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: stopping tablet replica
I20260812 01:14:06.580895 22396 raft_consensus.cc:2229] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:06.580960 22396 raft_consensus.cc:2258] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:06.581115 22398 raft_consensus.cc:2229] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:06.581198 22398 raft_consensus.cc:2258] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:06.581579 22398 ts_tablet_manager.cc:1905] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:06.583283 22398 ts_tablet_manager.cc:1918] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:06.583369 22398 log.cc:1196] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/b2ea0e5cadb54392ac0d3d961502d8e1
I20260812 01:14:06.583643 22398 ts_tablet_manager.cc:1939] T b2ea0e5cadb54392ac0d3d961502d8e1 P 6f250d40a0234fad8163a55445bf85d2: Deleting consensus metadata
I20260812 01:14:06.584040 21389 catalog_manager.cc:4841] TS 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665): tablet b2ea0e5cadb54392ac0d3d961502d8e1 (table test-table [id=ceb6e4b80d4f498f84e7f94db492fc91]) successfully deleted
I20260812 01:14:06.584749 22396 ts_tablet_manager.cc:1905] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:06.586067 22396 ts_tablet_manager.cc:1918] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:06.586144 22396 log.cc:1196] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/b2ea0e5cadb54392ac0d3d961502d8e1
I20260812 01:14:06.586406 22396 ts_tablet_manager.cc:1939] T b2ea0e5cadb54392ac0d3d961502d8e1 P b4ba11e4acd84664af189b744b3e69b2: Deleting consensus metadata
I20260812 01:14:06.586777 21382 catalog_manager.cc:4841] TS b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131:34779): tablet b2ea0e5cadb54392ac0d3d961502d8e1 (table test-table [id=ceb6e4b80d4f498f84e7f94db492fc91]) successfully deleted
I20260812 01:14:06.587095 22299 tablet_bootstrap.cc:492] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2: No bootstrap required, opened a new log
I20260812 01:14:06.587155 22299 ts_tablet_manager.cc:1397] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
I20260812 01:14:06.587298 22299 raft_consensus.cc:348] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.587373 22299 raft_consensus.cc:374] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:06.587399 22299 raft_consensus.cc:729] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4ba11e4acd84664af189b744b3e69b2, State: Initialized, Role: FOLLOWER
I20260812 01:14:06.587445 22299 consensus_queue.cc:260] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.587563 22299 ts_tablet_manager.cc:1428] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:06.730983 22307 raft_consensus.cc:482] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:06.731098 22307 raft_consensus.cc:504] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.731324 22307 leader_election.cc:288] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129:45555), 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665)
I20260812 01:14:06.731565 21667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74e366499e3141098a7b1a5593c5164f" candidate_uuid: "b4ba11e4acd84664af189b744b3e69b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d240d01f404b1eb309764c903e2cb6" is_pre_election: true
I20260812 01:14:06.731626 21906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74e366499e3141098a7b1a5593c5164f" candidate_uuid: "b4ba11e4acd84664af189b744b3e69b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f250d40a0234fad8163a55445bf85d2" is_pre_election: true
I20260812 01:14:06.731689 21667 raft_consensus.cc:2454] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4ba11e4acd84664af189b744b3e69b2 in term 0.
I20260812 01:14:06.731726 21906 raft_consensus.cc:2454] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4ba11e4acd84664af189b744b3e69b2 in term 0.
I20260812 01:14:06.731884 22022 leader_election.cc:302] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4ba11e4acd84664af189b744b3e69b2, f6d240d01f404b1eb309764c903e2cb6; no voters:
I20260812 01:14:06.732013 22307 raft_consensus.cc:2781] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:06.732054 22307 raft_consensus.cc:482] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:06.732077 22307 raft_consensus.cc:3037] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:06.732894 22307 raft_consensus.cc:504] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.733042 22307 leader_election.cc:288] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [CANDIDATE]: Term 1 election: Requested vote from peers f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129:45555), 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665)
I20260812 01:14:06.733209 21906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74e366499e3141098a7b1a5593c5164f" candidate_uuid: "b4ba11e4acd84664af189b744b3e69b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f250d40a0234fad8163a55445bf85d2"
I20260812 01:14:06.733242 21667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74e366499e3141098a7b1a5593c5164f" candidate_uuid: "b4ba11e4acd84664af189b744b3e69b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d240d01f404b1eb309764c903e2cb6"
I20260812 01:14:06.733304 21667 raft_consensus.cc:3037] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:06.733307 21906 raft_consensus.cc:3037] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:06.733951 21906 raft_consensus.cc:2454] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4ba11e4acd84664af189b744b3e69b2 in term 1.
I20260812 01:14:06.734074 21667 raft_consensus.cc:2454] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4ba11e4acd84664af189b744b3e69b2 in term 1.
I20260812 01:14:06.734222 22029 leader_election.cc:302] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f250d40a0234fad8163a55445bf85d2, b4ba11e4acd84664af189b744b3e69b2; no voters:
I20260812 01:14:06.734324 22307 raft_consensus.cc:2781] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:06.734424 22307 raft_consensus.cc:686] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 1 LEADER]: Becoming Leader. State: Replica: b4ba11e4acd84664af189b744b3e69b2, State: Running, Role: LEADER
I20260812 01:14:06.734484 22307 consensus_queue.cc:237] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:06.735128 21411 catalog_manager.cc:5495] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131). New cstate: current_term: 1 leader_uuid: "b4ba11e4acd84664af189b744b3e69b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } health_report { overall_health: HEALTHY } } }
I20260812 01:14:06.761261 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.759021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37932 (local address 127.17.183.131:34779)
0812 01:14:06.759085 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.759087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.759096 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:06.759119 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.759119 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.759129 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.759188 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:06.759331 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.759817 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.760569 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.760769 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.760846 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.761006 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:06.761045 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:06.761096 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.761161 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.761179 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 01:14:06.765755 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.763740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:40341 (local address 127.17.183.131:34779)
0812 01:14:06.763775 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:06.763779 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:06.763793 (+ 14us) server_negotiation.cc:407] Connection header received
0812 01:14:06.763840 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:06.763840 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:06.763847 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:06.763893 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:06.763996 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.764416 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.765173 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.765356 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.765411 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.765520 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:06.765578 (+ 58us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:06.765614 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:06.765664 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 01:14:06.765680 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 01:14:06.765763 22269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:06.763674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:34779 (local address 127.17.183.131:40341)
0812 01:14:06.763749 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:06.763767 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:06.763800 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:06.763913 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:06.763914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:06.763915 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:14:06.763948 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.763949 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.764474 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.764475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.765070 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:06.765072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:06.765424 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:06.765425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:06.765463 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:06.765467 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:14:06.765627 (+ 160us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:14:06.765628 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 01:14:06.765663 (+ 35us) client_negotiation.cc:240] Negotiation successful
0812 01:14:06.765695 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 01:14:06.767740 21667 raft_consensus.cc:1261] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Refusing update from remote peer b4ba11e4acd84664af189b744b3e69b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:06.767771 21906 raft_consensus.cc:1261] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Refusing update from remote peer b4ba11e4acd84664af189b744b3e69b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:06.767973 22307 consensus_queue.cc:1035] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:06.768105 22379 consensus_queue.cc:1035] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 01:14:06.772639 22351 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 01:14:08.301298 21411 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48446:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:08.301442 21411 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48446:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:08.302466 21411 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2: Sending DeleteTablet for 3 replicas of tablet 74e366499e3141098a7b1a5593c5164f
I20260812 01:14:08.302780 21874 tablet_service.cc:1514] Processing DeleteTablet for tablet 74e366499e3141098a7b1a5593c5164f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:08 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:42218
I20260812 01:14:08.302816 21639 tablet_service.cc:1514] Processing DeleteTablet for tablet 74e366499e3141098a7b1a5593c5164f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:08 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:54790
I20260812 01:14:08.302860 22123 tablet_service.cc:1514] Processing DeleteTablet for tablet 74e366499e3141098a7b1a5593c5164f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:08 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:37914
I20260812 01:14:08.303086 22447 tablet_replica.cc:330] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2: stopping tablet replica
I20260812 01:14:08.303187 22447 raft_consensus.cc:2229] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:08.303318 22448 tablet_replica.cc:330] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6: stopping tablet replica
I20260812 01:14:08.303330 22447 raft_consensus.cc:2258] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:08.303442 22448 raft_consensus.cc:2229] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:08.303543 22448 raft_consensus.cc:2258] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:08.303831 22447 ts_tablet_manager.cc:1905] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:08.306460 22449 tablet_replica.cc:330] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2: stopping tablet replica
I20260812 01:14:08.306603 22449 raft_consensus.cc:2229] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:08.306638 22447 ts_tablet_manager.cc:1918] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 01:14:08.306792 22449 raft_consensus.cc:2258] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:08.306838 22447 log.cc:1196] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/74e366499e3141098a7b1a5593c5164f
I20260812 01:14:08.307073 22448 ts_tablet_manager.cc:1905] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:08.307212 22449 ts_tablet_manager.cc:1905] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:08.307554 22447 ts_tablet_manager.cc:1939] T 74e366499e3141098a7b1a5593c5164f P 6f250d40a0234fad8163a55445bf85d2: Deleting consensus metadata
I20260812 01:14:08.308143 21389 catalog_manager.cc:4841] TS 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665): tablet 74e366499e3141098a7b1a5593c5164f (table test-table [id=e60bc50a1efa494cb40308479c0d5510]) successfully deleted
I20260812 01:14:08.309603 22448 ts_tablet_manager.cc:1918] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 01:14:08.309712 22448 log.cc:1196] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/74e366499e3141098a7b1a5593c5164f
I20260812 01:14:08.310276 22448 ts_tablet_manager.cc:1939] T 74e366499e3141098a7b1a5593c5164f P f6d240d01f404b1eb309764c903e2cb6: Deleting consensus metadata
I20260812 01:14:08.310808 22449 ts_tablet_manager.cc:1918] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 01:14:08.311161 22449 log.cc:1196] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/74e366499e3141098a7b1a5593c5164f
I20260812 01:14:08.311223 21382 catalog_manager.cc:4841] TS f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129:45555): tablet 74e366499e3141098a7b1a5593c5164f (table test-table [id=e60bc50a1efa494cb40308479c0d5510]) successfully deleted
I20260812 01:14:08.314150 22449 ts_tablet_manager.cc:1939] T 74e366499e3141098a7b1a5593c5164f P b4ba11e4acd84664af189b744b3e69b2: Deleting consensus metadata
I20260812 01:14:08.317471 21382 catalog_manager.cc:4841] TS b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131:34779): tablet 74e366499e3141098a7b1a5593c5164f (table test-table [id=e60bc50a1efa494cb40308479c0d5510]) successfully deleted
Aug 12 01:14:08 dist-test-slave-rwrg krb5kdc[21332](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260812 01:14:08.411139 18142 mini_kdc.cc:317] Time spent kinit for test-user: real 0.108s user 0.000s sys 0.031s
Aug 12 01:14:08 dist-test-slave-rwrg krb5kdc[21332](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:08.439134 22472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:08.413424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48460 (local address 127.17.183.190:43171)
0812 01:14:08.413649 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:08.413650 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:08.413662 (+ 12us) server_negotiation.cc:407] Connection header received
0812 01:14:08.413804 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:08.413805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:08.413823 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:08.414000 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:08.415039 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:08.416937 (+ 1898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:08.419680 (+ 2743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:08.419994 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:08.420197 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:08.429154 (+ 8957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:08.429157 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:08.429157 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:08.429165 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:08.432365 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:08.433806 (+ 1441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:08.433807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:08.433807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:08.434149 (+ 342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:08.435129 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:08.435133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:08.435135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:08.435653 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:08.436069 (+ 416us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:08.436846 (+ 777us) server_negotiation.cc:299] Negotiation successful
0812 01:14:08.437889 (+ 1043us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":156,"threads_started":1}
I20260812 01:14:08.446136 21411 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:08.446825 21411 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:08.451148 21874 tablet_service.cc:1467] Processing CreateTablet for tablet 960f12fa5a4845c1a3d8e6792dcf9643 (DEFAULT_TABLE table=test-table [id=15dbc7effcef4619831964f1717eca56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:08.451449 21639 tablet_service.cc:1467] Processing CreateTablet for tablet 960f12fa5a4845c1a3d8e6792dcf9643 (DEFAULT_TABLE table=test-table [id=15dbc7effcef4619831964f1717eca56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:08.451362 22123 tablet_service.cc:1467] Processing CreateTablet for tablet 960f12fa5a4845c1a3d8e6792dcf9643 (DEFAULT_TABLE table=test-table [id=15dbc7effcef4619831964f1717eca56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:08.451740 21874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960f12fa5a4845c1a3d8e6792dcf9643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:08.452016 22123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960f12fa5a4845c1a3d8e6792dcf9643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:08.452049 21639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960f12fa5a4845c1a3d8e6792dcf9643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:08.456454 22474 tablet_bootstrap.cc:492] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2: Bootstrap starting.
I20260812 01:14:08.457398 22474 tablet_bootstrap.cc:654] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:08.457691 22477 tablet_bootstrap.cc:492] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2: Bootstrap starting.
I20260812 01:14:08.457976 22478 tablet_bootstrap.cc:492] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6: Bootstrap starting.
I20260812 01:14:08.458333 22477 tablet_bootstrap.cc:654] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:08.458576 22478 tablet_bootstrap.cc:654] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:08.458737 22474 tablet_bootstrap.cc:492] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2: No bootstrap required, opened a new log
I20260812 01:14:08.458834 22474 ts_tablet_manager.cc:1397] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 01:14:08.459048 22474 raft_consensus.cc:348] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.459144 22474 raft_consensus.cc:374] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:08.459187 22474 raft_consensus.cc:729] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f250d40a0234fad8163a55445bf85d2, State: Initialized, Role: FOLLOWER
I20260812 01:14:08.459277 22477 tablet_bootstrap.cc:492] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2: No bootstrap required, opened a new log
I20260812 01:14:08.459275 22474 consensus_queue.cc:260] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.459328 22477 ts_tablet_manager.cc:1397] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:14:08.459520 22474 ts_tablet_manager.cc:1428] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:08.459548 22477 raft_consensus.cc:348] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.459648 22477 raft_consensus.cc:374] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:08.459688 22477 raft_consensus.cc:729] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4ba11e4acd84664af189b744b3e69b2, State: Initialized, Role: FOLLOWER
I20260812 01:14:08.459808 22477 consensus_queue.cc:260] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.459995 22477 ts_tablet_manager.cc:1428] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:08.460326 22478 tablet_bootstrap.cc:492] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6: No bootstrap required, opened a new log
I20260812 01:14:08.460429 22478 ts_tablet_manager.cc:1397] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:14:08.460682 22478 raft_consensus.cc:348] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.460834 22478 raft_consensus.cc:374] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:08.460888 22478 raft_consensus.cc:729] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d240d01f404b1eb309764c903e2cb6, State: Initialized, Role: FOLLOWER
I20260812 01:14:08.460978 22478 consensus_queue.cc:260] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.461305 22478 ts_tablet_manager.cc:1428] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:08.510458 22486 raft_consensus.cc:482] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:08.510613 22486 raft_consensus.cc:504] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.510934 22486 leader_election.cc:288] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665), b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131:34779)
I20260812 01:14:08.511162 21906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960f12fa5a4845c1a3d8e6792dcf9643" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f250d40a0234fad8163a55445bf85d2" is_pre_election: true
I20260812 01:14:08.511343 21906 raft_consensus.cc:2454] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 0.
I20260812 01:14:08.511274 22163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960f12fa5a4845c1a3d8e6792dcf9643" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ba11e4acd84664af189b744b3e69b2" is_pre_election: true
I20260812 01:14:08.511502 22163 raft_consensus.cc:2454] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 0.
I20260812 01:14:08.511679 21559 leader_election.cc:302] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f250d40a0234fad8163a55445bf85d2, f6d240d01f404b1eb309764c903e2cb6; no voters:
I20260812 01:14:08.511826 22486 raft_consensus.cc:2781] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:08.511912 22486 raft_consensus.cc:482] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:08.511991 22486 raft_consensus.cc:3037] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:08.513262 22486 raft_consensus.cc:504] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.513481 22486 leader_election.cc:288] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665), b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131:34779)
I20260812 01:14:08.513674 21906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960f12fa5a4845c1a3d8e6792dcf9643" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f250d40a0234fad8163a55445bf85d2"
I20260812 01:14:08.513842 21906 raft_consensus.cc:3037] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:08.513759 22163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960f12fa5a4845c1a3d8e6792dcf9643" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ba11e4acd84664af189b744b3e69b2"
I20260812 01:14:08.513890 22163 raft_consensus.cc:3037] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:08.514765 21906 raft_consensus.cc:2454] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 1.
I20260812 01:14:08.514986 22163 raft_consensus.cc:2454] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 1.
I20260812 01:14:08.515005 21559 leader_election.cc:302] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f250d40a0234fad8163a55445bf85d2, f6d240d01f404b1eb309764c903e2cb6; no voters:
I20260812 01:14:08.515290 22486 raft_consensus.cc:2781] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:08.515552 22486 raft_consensus.cc:686] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 1 LEADER]: Becoming Leader. State: Replica: f6d240d01f404b1eb309764c903e2cb6, State: Running, Role: LEADER
I20260812 01:14:08.515621 22486 consensus_queue.cc:237] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.516714 21411 catalog_manager.cc:5495] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129). New cstate: current_term: 1 leader_uuid: "f6d240d01f404b1eb309764c903e2cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260812 01:14:08.539978 22493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:08.536603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54804 (local address 127.17.183.129:45555)
0812 01:14:08.536812 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:08.536818 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:08.536826 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:08.536901 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:08.536902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:08.536916 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:08.537058 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:08.537247 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:08.537979 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:08.539021 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:08.539261 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:08.539391 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:08.539625 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:08.539660 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:08.539719 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:08.539808 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 01:14:08.539832 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":136,"threads_started":1}
I20260812 01:14:08.543136 22163 raft_consensus.cc:1261] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Refusing update from remote peer f6d240d01f404b1eb309764c903e2cb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:08.543393 21906 raft_consensus.cc:1261] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Refusing update from remote peer f6d240d01f404b1eb309764c903e2cb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:08.543454 22487 consensus_queue.cc:1035] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:08.543807 22487 consensus_queue.cc:1035] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:08.563344 21412 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:08.563534 21412 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:08.564606 21412 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2: Sending DeleteTablet for 3 replicas of tablet 960f12fa5a4845c1a3d8e6792dcf9643
I20260812 01:14:08.565040 21639 tablet_service.cc:1514] Processing DeleteTablet for tablet 960f12fa5a4845c1a3d8e6792dcf9643 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:08 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:54790
I20260812 01:14:08.565074 22123 tablet_service.cc:1514] Processing DeleteTablet for tablet 960f12fa5a4845c1a3d8e6792dcf9643 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:08 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:37914
I20260812 01:14:08.565089 21874 tablet_service.cc:1514] Processing DeleteTablet for tablet 960f12fa5a4845c1a3d8e6792dcf9643 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:08 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:42218
I20260812 01:14:08.565160 22449 tablet_replica.cc:330] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2: stopping tablet replica
I20260812 01:14:08.565217 22449 raft_consensus.cc:2229] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:08.565215 22447 tablet_replica.cc:330] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2: stopping tablet replica
I20260812 01:14:08.565228 22448 tablet_replica.cc:330] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6: stopping tablet replica
I20260812 01:14:08.565275 22449 raft_consensus.cc:2258] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:08.565306 22447 raft_consensus.cc:2229] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:08.565352 22448 raft_consensus.cc:2229] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:08.565384 22447 raft_consensus.cc:2258] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:08.565539 22448 raft_consensus.cc:2258] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:08.566152 22447 ts_tablet_manager.cc:1905] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:08.566239 22449 ts_tablet_manager.cc:1905] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:08.566203 21412 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:08.566466 21412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:08.568452 22123 tablet_service.cc:1467] Processing CreateTablet for tablet a8f51498389b4c01a650d14e15ffdca4 (DEFAULT_TABLE table=test-table [id=dc2a939677b9462c9657ff8f319d5ac6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:08.568485 21874 tablet_service.cc:1467] Processing CreateTablet for tablet a8f51498389b4c01a650d14e15ffdca4 (DEFAULT_TABLE table=test-table [id=dc2a939677b9462c9657ff8f319d5ac6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:08.568627 22447 ts_tablet_manager.cc:1918] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:08.568642 22449 ts_tablet_manager.cc:1918] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:08.568724 22447 log.cc:1196] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/960f12fa5a4845c1a3d8e6792dcf9643
I20260812 01:14:08.568724 22449 log.cc:1196] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/960f12fa5a4845c1a3d8e6792dcf9643
I20260812 01:14:08.568738 21874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8f51498389b4c01a650d14e15ffdca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:08.569207 22449 ts_tablet_manager.cc:1939] T 960f12fa5a4845c1a3d8e6792dcf9643 P b4ba11e4acd84664af189b744b3e69b2: Deleting consensus metadata
I20260812 01:14:08.569175 22447 ts_tablet_manager.cc:1939] T 960f12fa5a4845c1a3d8e6792dcf9643 P 6f250d40a0234fad8163a55445bf85d2: Deleting consensus metadata
I20260812 01:14:08.569240 21639 tablet_service.cc:1467] Processing CreateTablet for tablet a8f51498389b4c01a650d14e15ffdca4 (DEFAULT_TABLE table=test-table [id=dc2a939677b9462c9657ff8f319d5ac6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:08.569451 21639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8f51498389b4c01a650d14e15ffdca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:08.568738 22123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8f51498389b4c01a650d14e15ffdca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:08.569851 22448 ts_tablet_manager.cc:1905] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:08.571178 22474 tablet_bootstrap.cc:492] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2: Bootstrap starting.
I20260812 01:14:08.572047 21382 catalog_manager.cc:4841] TS b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131:34779): tablet 960f12fa5a4845c1a3d8e6792dcf9643 (table test-table [id=15dbc7effcef4619831964f1717eca56]) successfully deleted
I20260812 01:14:08.572227 22474 tablet_bootstrap.cc:654] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:08.572600 22448 ts_tablet_manager.cc:1918] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:08.572685 22448 log.cc:1196] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/960f12fa5a4845c1a3d8e6792dcf9643
I20260812 01:14:08.573144 22448 ts_tablet_manager.cc:1939] T 960f12fa5a4845c1a3d8e6792dcf9643 P f6d240d01f404b1eb309764c903e2cb6: Deleting consensus metadata
I20260812 01:14:08.573184 21389 catalog_manager.cc:4841] TS 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665): tablet 960f12fa5a4845c1a3d8e6792dcf9643 (table test-table [id=15dbc7effcef4619831964f1717eca56]) successfully deleted
I20260812 01:14:08.573513 22477 tablet_bootstrap.cc:492] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2: Bootstrap starting.
I20260812 01:14:08.573608 22474 tablet_bootstrap.cc:492] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2: No bootstrap required, opened a new log
I20260812 01:14:08.573639 21382 catalog_manager.cc:4841] TS f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129:45555): tablet 960f12fa5a4845c1a3d8e6792dcf9643 (table test-table [id=15dbc7effcef4619831964f1717eca56]) successfully deleted
I20260812 01:14:08.573680 22474 ts_tablet_manager.cc:1397] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 01:14:08.573959 22474 raft_consensus.cc:348] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.574069 22474 raft_consensus.cc:374] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:08.574036 22477 tablet_bootstrap.cc:654] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:08.574110 22474 raft_consensus.cc:729] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f250d40a0234fad8163a55445bf85d2, State: Initialized, Role: FOLLOWER
I20260812 01:14:08.574220 22474 consensus_queue.cc:260] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.574460 22474 ts_tablet_manager.cc:1428] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:08.574512 22478 tablet_bootstrap.cc:492] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6: Bootstrap starting.
I20260812 01:14:08.575042 22478 tablet_bootstrap.cc:654] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:08.575307 22477 tablet_bootstrap.cc:492] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2: No bootstrap required, opened a new log
I20260812 01:14:08.575371 22477 ts_tablet_manager.cc:1397] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:14:08.575553 22477 raft_consensus.cc:348] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.575639 22477 raft_consensus.cc:374] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:08.575702 22477 raft_consensus.cc:729] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4ba11e4acd84664af189b744b3e69b2, State: Initialized, Role: FOLLOWER
I20260812 01:14:08.575822 22477 consensus_queue.cc:260] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.575882 22478 tablet_bootstrap.cc:492] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6: No bootstrap required, opened a new log
I20260812 01:14:08.575989 22478 ts_tablet_manager.cc:1397] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:14:08.576026 22477 ts_tablet_manager.cc:1428] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 01:14:08.576131 22478 raft_consensus.cc:348] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.576246 22478 raft_consensus.cc:374] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:08.576284 22478 raft_consensus.cc:729] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d240d01f404b1eb309764c903e2cb6, State: Initialized, Role: FOLLOWER
I20260812 01:14:08.576357 22478 consensus_queue.cc:260] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.576709 22478 ts_tablet_manager.cc:1428] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:08.691951 22486 raft_consensus.cc:482] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:08.692111 22486 raft_consensus.cc:504] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.692344 22486 leader_election.cc:288] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665), b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131:34779)
I20260812 01:14:08.692651 22163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8f51498389b4c01a650d14e15ffdca4" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ba11e4acd84664af189b744b3e69b2" is_pre_election: true
I20260812 01:14:08.692817 22163 raft_consensus.cc:2454] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 0.
I20260812 01:14:08.692750 21905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8f51498389b4c01a650d14e15ffdca4" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f250d40a0234fad8163a55445bf85d2" is_pre_election: true
I20260812 01:14:08.693048 21905 raft_consensus.cc:2454] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 0.
I20260812 01:14:08.693116 21554 leader_election.cc:302] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4ba11e4acd84664af189b744b3e69b2, f6d240d01f404b1eb309764c903e2cb6; no voters:
I20260812 01:14:08.693297 22486 raft_consensus.cc:2781] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:08.693404 22486 raft_consensus.cc:482] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:08.693463 22486 raft_consensus.cc:3037] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:08.694840 22486 raft_consensus.cc:504] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.695118 22486 leader_election.cc:288] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665), b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131:34779)
I20260812 01:14:08.695401 21905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8f51498389b4c01a650d14e15ffdca4" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f250d40a0234fad8163a55445bf85d2"
I20260812 01:14:08.695546 21905 raft_consensus.cc:3037] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:08.695513 22163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8f51498389b4c01a650d14e15ffdca4" candidate_uuid: "f6d240d01f404b1eb309764c903e2cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ba11e4acd84664af189b744b3e69b2"
I20260812 01:14:08.695713 22163 raft_consensus.cc:3037] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:08.696961 21905 raft_consensus.cc:2454] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 1.
I20260812 01:14:08.697053 22163 raft_consensus.cc:2454] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d240d01f404b1eb309764c903e2cb6 in term 1.
I20260812 01:14:08.697193 21559 leader_election.cc:302] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f250d40a0234fad8163a55445bf85d2, f6d240d01f404b1eb309764c903e2cb6; no voters:
I20260812 01:14:08.697322 22486 raft_consensus.cc:2781] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:08.697472 22486 raft_consensus.cc:686] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [term 1 LEADER]: Becoming Leader. State: Replica: f6d240d01f404b1eb309764c903e2cb6, State: Running, Role: LEADER
I20260812 01:14:08.697656 22486 consensus_queue.cc:237] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } }
I20260812 01:14:08.698818 21411 catalog_manager.cc:5495] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129). New cstate: current_term: 1 leader_uuid: "f6d240d01f404b1eb309764c903e2cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d240d01f404b1eb309764c903e2cb6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260812 01:14:08.729902 21905 raft_consensus.cc:1261] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Refusing update from remote peer f6d240d01f404b1eb309764c903e2cb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:08.729882 22163 raft_consensus.cc:1261] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Refusing update from remote peer f6d240d01f404b1eb309764c903e2cb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:08.730240 22499 consensus_queue.cc:1035] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4ba11e4acd84664af189b744b3e69b2" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:08.730378 22486 consensus_queue.cc:1035] T a8f51498389b4c01a650d14e15ffdca4 P f6d240d01f404b1eb309764c903e2cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f250d40a0234fad8163a55445bf85d2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 33665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 01:14:08.738443 22415 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 01:14:10.274699 21411 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:10.274854 21411 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:10.276166 21411 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c4bb0d2971ca47479423a77f9404ddf2: Sending DeleteTablet for 3 replicas of tablet a8f51498389b4c01a650d14e15ffdca4
I20260812 01:14:10.276732 21874 tablet_service.cc:1514] Processing DeleteTablet for tablet a8f51498389b4c01a650d14e15ffdca4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:10 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:42218
I20260812 01:14:10.276717 21639 tablet_service.cc:1514] Processing DeleteTablet for tablet a8f51498389b4c01a650d14e15ffdca4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:10 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:54790
I20260812 01:14:10.277024 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 21529
I20260812 01:14:10.277164 22123 tablet_service.cc:1514] Processing DeleteTablet for tablet a8f51498389b4c01a650d14e15ffdca4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:10 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:37914
I20260812 01:14:10.297060 22562 tablet_replica.cc:330] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2: stopping tablet replica
I20260812 01:14:10.297186 22562 raft_consensus.cc:2229] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:10.297250 22562 raft_consensus.cc:2258] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:10.297971 22563 tablet_replica.cc:330] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2: stopping tablet replica
I20260812 01:14:10.298127 22563 raft_consensus.cc:2229] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:10.298233 22563 raft_consensus.cc:2258] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:10.298830 22563 ts_tablet_manager.cc:1905] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:10.302016 22562 ts_tablet_manager.cc:1905] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:10.302050 22563 ts_tablet_manager.cc:1918] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 01:14:10.302203 22563 log.cc:1196] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/a8f51498389b4c01a650d14e15ffdca4
I20260812 01:14:10.302614 22563 ts_tablet_manager.cc:1939] T a8f51498389b4c01a650d14e15ffdca4 P b4ba11e4acd84664af189b744b3e69b2: Deleting consensus metadata
I20260812 01:14:10.303231 21382 catalog_manager.cc:4841] TS b4ba11e4acd84664af189b744b3e69b2 (127.17.183.131:34779): tablet a8f51498389b4c01a650d14e15ffdca4 (table test-table [id=dc2a939677b9462c9657ff8f319d5ac6]) successfully deleted
I20260812 01:14:10.305220 22562 ts_tablet_manager.cc:1918] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 01:14:10.305351 22562 log.cc:1196] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/a8f51498389b4c01a650d14e15ffdca4
I20260812 01:14:10.305670 22562 ts_tablet_manager.cc:1939] T a8f51498389b4c01a650d14e15ffdca4 P 6f250d40a0234fad8163a55445bf85d2: Deleting consensus metadata
I20260812 01:14:10.306203 21389 catalog_manager.cc:4841] TS 6f250d40a0234fad8163a55445bf85d2 (127.17.183.130:33665): tablet a8f51498389b4c01a650d14e15ffdca4 (table test-table [id=dc2a939677b9462c9657ff8f319d5ac6]) successfully deleted
W20260812 01:14:10.315284 21382 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:45555 (error 108)
I20260812 01:14:10.315688 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 21751
I20260812 01:14:10.330062 22566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:10.315929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45555 (local address 127.0.0.1:54810)
0812 01:14:10.329799 (+ 13870us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:10.329943 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:45555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13805,"thread_start_us":93,"threads_started":1}
W20260812 01:14:10.330353 21382 catalog_manager.cc:4584] TS f6d240d01f404b1eb309764c903e2cb6 (127.17.183.129:45555): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a8f51498389b4c01a650d14e15ffdca4: Network error: Client connection negotiation failed: client connection to 127.17.183.129:45555: connect: Connection refused (error 111)
I20260812 01:14:10.352304 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 21997
I20260812 01:14:10.365432 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 21354
2026-08-12T01:14:10Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6419 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:10 dist-test-slave-rwrg krb5kdc[22572](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:10 dist-test-slave-rwrg krb5kdc[22572](info): set up 2 sockets
Aug 12 01:14:10 dist-test-slave-rwrg krb5kdc[22572](info): commencing operation
krb5kdc: starting...
W20260812 01:14:11.802543 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.376s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:11 dist-test-slave-rwrg krb5kdc[22572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:14:11.930742 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:34811
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:34811
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:12.014919 22601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:12.015128 22601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:12.015152 22601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:12.016315 22601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:12.016364 22601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:12.016378 22601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:12.016391 22601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:12.016448 22601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:12.017975 22601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:34811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:34811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:12.018257 22601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:12.018501 22601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:12.023639 22622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:12.023710 22614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:12.023703 22601 server_base.cc:1034] running on GCE node
W20260812 01:14:12.023649 22612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:12.024163 22601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:12.024421 22601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:12.025609 22601 hybrid_clock.cc:648] HybridClock initialized: now 1786497252025594 us; error 30 us; skew 500 ppm
Aug 12 01:14:12 dist-test-slave-rwrg krb5kdc[22572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497252, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:12.028083 22601 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:14:12.028671 22601 webserver.cc:460] Webserver started at http://127.17.183.190:34111/ using document root <none> and password file <none>
I20260812 01:14:12.028930 22601 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:12.029001 22601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:12.029142 22601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:12.030239 22601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "504d8280fafb4a6092ecba1ffb18ce73"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "74eea594f4a76ef89e1967aba3359c8d"
server_key_iv: "28ce2d0daffee99f5c4f6d20ae25443e"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.030617 22601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "504d8280fafb4a6092ecba1ffb18ce73"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "74eea594f4a76ef89e1967aba3359c8d"
server_key_iv: "28ce2d0daffee99f5c4f6d20ae25443e"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.031998 22601 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:12.032800 22631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:12.032984 22601 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:12.033097 22601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "504d8280fafb4a6092ecba1ffb18ce73"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "74eea594f4a76ef89e1967aba3359c8d"
server_key_iv: "28ce2d0daffee99f5c4f6d20ae25443e"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.033183 22601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:12.066730 22601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:12.068869 22601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:12.069049 22601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:12.073452 22601 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:34811
I20260812 01:14:12.073493 22724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:34811 every 8 connection(s)
I20260812 01:14:12.073918 22601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:12.074836 22725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:12.076413 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 22601
I20260812 01:14:12.076586 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:12.076773 18142 external_mini_cluster.cc:1428] Setting key 5ec48fbede8d44d2b4334d81891fb6a7
I20260812 01:14:12.077576 22725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73: Bootstrap starting.
I20260812 01:14:12.078284 22725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:12.078637 22725 log.cc:824] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:12.079490 22725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73: No bootstrap required, opened a new log
I20260812 01:14:12.081821 22725 raft_consensus.cc:348] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504d8280fafb4a6092ecba1ffb18ce73" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34811 } }
I20260812 01:14:12.081988 22725 raft_consensus.cc:374] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:12.082023 22725 raft_consensus.cc:729] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504d8280fafb4a6092ecba1ffb18ce73, State: Initialized, Role: FOLLOWER
I20260812 01:14:12.082170 22725 consensus_queue.cc:260] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504d8280fafb4a6092ecba1ffb18ce73" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34811 } }
I20260812 01:14:12.082253 22725 raft_consensus.cc:388] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:12.082307 22725 raft_consensus.cc:482] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:12.082351 22725 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:12.083046 22725 raft_consensus.cc:504] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504d8280fafb4a6092ecba1ffb18ce73" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34811 } }
I20260812 01:14:12.083143 22725 leader_election.cc:302] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 504d8280fafb4a6092ecba1ffb18ce73; no voters:
I20260812 01:14:12.083330 22725 leader_election.cc:288] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:12.083374 22732 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:12.083504 22732 raft_consensus.cc:686] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [term 1 LEADER]: Becoming Leader. State: Replica: 504d8280fafb4a6092ecba1ffb18ce73, State: Running, Role: LEADER
I20260812 01:14:12.083669 22725 sys_catalog.cc:564] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:12.083698 22732 consensus_queue.cc:237] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504d8280fafb4a6092ecba1ffb18ce73" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34811 } }
I20260812 01:14:12.084074 22732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 504d8280fafb4a6092ecba1ffb18ce73. Latest consensus state: current_term: 1 leader_uuid: "504d8280fafb4a6092ecba1ffb18ce73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504d8280fafb4a6092ecba1ffb18ce73" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34811 } } }
I20260812 01:14:12.084331 22732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:12.084249 22734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "504d8280fafb4a6092ecba1ffb18ce73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504d8280fafb4a6092ecba1ffb18ce73" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34811 } } }
I20260812 01:14:12.084658 22734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73 [sys.catalog]: This master's current role is: LEADER
Aug 12 01:14:12 dist-test-slave-rwrg krb5kdc[22572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:12.084843 22747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:12.085417 22747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:12.088001 22747 catalog_manager.cc:1347] Generated new cluster ID: b03d35247af643a38a2fb2b9aba02eb5
I20260812 01:14:12.088065 22747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:12.089730 22730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:12.077363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57648 (local address 127.17.183.190:34811)
0812 01:14:12.077573 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:12.077591 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:12.077631 (+ 40us) server_negotiation.cc:407] Connection header received
0812 01:14:12.078226 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:12.078235 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:12.078300 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:12.078452 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:12.079231 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.080642 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.081456 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.082090 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.082201 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:12.085630 (+ 3429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:12.085634 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:12.085634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:12.085646 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:12.087896 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:12.088340 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:12.088343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:12.088344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:12.088443 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:12.088713 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:12.088714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:12.088714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:12.088999 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:12.089143 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:12.089379 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 01:14:12.089512 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":95,"threads_started":1}
I20260812 01:14:12.094246 22747 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:12.094789 22747 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:12.104410 22747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 504d8280fafb4a6092ecba1ffb18ce73: Generated new TSK 0
I20260812 01:14:12.104640 22747 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:14:12.135455 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34811
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:12.220665 22769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:12.220904 22769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:12.220928 22769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:12.222080 22769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:12.222114 22769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:12.222141 22769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:12.223459 22769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:12.223755 22769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:12.223945 22769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:12.229022 22777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:12.229030 22782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:12.229223 22769 server_base.cc:1034] running on GCE node
W20260812 01:14:12.229053 22778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:12.229517 22769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:12.229796 22769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:12.230948 22769 hybrid_clock.cc:648] HybridClock initialized: now 1786497252230939 us; error 29 us; skew 500 ppm
Aug 12 01:14:12 dist-test-slave-rwrg krb5kdc[22572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497252, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:12.233600 22769 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:14:12.234057 22769 webserver.cc:460] Webserver started at http://127.17.183.129:44249/ using document root <none> and password file <none>
I20260812 01:14:12.234253 22769 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:12.234295 22769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:12.234380 22769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:12.235325 22769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "373721e160f54d4a80531ee78f0c14c8"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "4c552f7095d35ef27397c069f7a4fa4b"
server_key_iv: "3a84fb6090a589362d6a75a315dd8ae4"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.235652 22769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "373721e160f54d4a80531ee78f0c14c8"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "4c552f7095d35ef27397c069f7a4fa4b"
server_key_iv: "3a84fb6090a589362d6a75a315dd8ae4"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.237255 22769 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:12.237970 22796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:12.238159 22769 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:12.238236 22769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "373721e160f54d4a80531ee78f0c14c8"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "4c552f7095d35ef27397c069f7a4fa4b"
server_key_iv: "3a84fb6090a589362d6a75a315dd8ae4"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.238293 22769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:12.253932 22769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:12.255563 22769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:12.255666 22769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:12.255842 22769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:12.256068 22769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:12.256095 22769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:12.256114 22769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:12.256125 22769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:12.262470 22769 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:45893
I20260812 01:14:12.262529 22985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:45893 every 8 connection(s)
I20260812 01:14:12.262823 22769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
Aug 12 01:14:12 dist-test-slave-rwrg krb5kdc[22572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497252, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:12.271168 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 22769
I20260812 01:14:12.271284 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:12.271482 18142 external_mini_cluster.cc:1428] Setting key 667f055abff974d859bdea43dd8ed061
I20260812 01:14:12.272171 22730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:12.263729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:44067 (local address 127.17.183.190:34811)
0812 01:14:12.263817 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:12.263820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:12.264012 (+ 192us) server_negotiation.cc:407] Connection header received
0812 01:14:12.264543 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:12.264545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:12.264558 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:12.264621 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:12.265565 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.266056 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.267028 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.267246 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.267337 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:12.269449 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:12.269450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:12.269450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:12.269458 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:12.270649 (+ 1191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:12.271030 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:12.271031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:12.271031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:12.271121 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:12.271442 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:12.271442 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:12.271443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:12.271595 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:12.271680 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:12.271981 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 01:14:12.272070 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 01:14:12.272351 22992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:12.263709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:34811 (local address 127.17.183.129:44067)
0812 01:14:12.263891 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:12.263925 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:12.264412 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:12.264696 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:12.264699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:12.265281 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:12.265454 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:12.265458 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.266163 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.266165 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:12.266933 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:12.266935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.267362 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.267364 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:12.267475 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:12.267963 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:12.267971 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:12.269349 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:12.270740 (+ 1391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:12.270747 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:12.270749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:12.270955 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:12.271197 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:12.271198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:12.271198 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:12.271336 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:12.271670 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:12.271678 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:12.271829 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 01:14:12.271958 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 01:14:12.272107 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
I20260812 01:14:12.272791 22987 heartbeater.cc:347] Connected to a master server at 127.17.183.190:34811
I20260812 01:14:12.272881 22987 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:12.273074 22987 heartbeater.cc:511] Master 127.17.183.190:34811 requested a full tablet report, sending...
I20260812 01:14:12.273880 22662 ts_manager.cc:194] Registered new tserver with Master: 373721e160f54d4a80531ee78f0c14c8 (127.17.183.129:45893)
I20260812 01:14:12.274528 22662 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:44067
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:14:12.297704 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34811
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:12.380136 22995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:12.380357 22995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:12.380395 22995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:12.381529 22995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:12.381601 22995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:12.381645 22995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:12.383070 22995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:12.383337 22995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:12.383564 22995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:12.388726 23001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:12.388798 23005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:12.388747 23003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:12.388974 22995 server_base.cc:1034] running on GCE node
I20260812 01:14:12.389276 22995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:12.389519 22995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:12.390684 22995 hybrid_clock.cc:648] HybridClock initialized: now 1786497252390661 us; error 58 us; skew 500 ppm
Aug 12 01:14:12 dist-test-slave-rwrg krb5kdc[22572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497252, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:12.393380 22995 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:14:12.393815 22995 webserver.cc:460] Webserver started at http://127.17.183.130:41383/ using document root <none> and password file <none>
I20260812 01:14:12.394114 22995 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:12.394186 22995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:12.394347 22995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:12.395388 22995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "483cdd5cfca242f4b2787e9015d40d7e"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "9035d2bb9a8e0c31e16c1f407a97027c"
server_key_iv: "ea8c287287e15edacfa7fcf9641d258a"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.395735 22995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "483cdd5cfca242f4b2787e9015d40d7e"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "9035d2bb9a8e0c31e16c1f407a97027c"
server_key_iv: "ea8c287287e15edacfa7fcf9641d258a"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.397172 22995 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260812 01:14:12.397941 23016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:12.398116 22995 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:12.398226 22995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "483cdd5cfca242f4b2787e9015d40d7e"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "9035d2bb9a8e0c31e16c1f407a97027c"
server_key_iv: "ea8c287287e15edacfa7fcf9641d258a"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.398315 22995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:12.410512 22995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:12.413231 22995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:12.413388 22995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:12.413620 22995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:12.413916 22995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:12.413949 22995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:12.414003 22995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:12.414032 22995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:12.419901 22995 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:41169
I20260812 01:14:12.419986 23233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:41169 every 8 connection(s)
I20260812 01:14:12.420337 22995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:12.423014 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 22995
I20260812 01:14:12.423146 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:12.423327 18142 external_mini_cluster.cc:1428] Setting key ba1ff891b0a4261bcb46356a50bd2856
Aug 12 01:14:12 dist-test-slave-rwrg krb5kdc[22572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497252, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:12.430498 22730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:12.421084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:36483 (local address 127.17.183.190:34811)
0812 01:14:12.421145 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:12.421147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:12.421345 (+ 198us) server_negotiation.cc:407] Connection header received
0812 01:14:12.421886 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:12.421888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:12.421898 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:12.421955 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:12.422813 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.423382 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.424835 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.425016 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.425072 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:12.427506 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:12.427508 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:12.427508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:12.427516 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:12.429029 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:12.429467 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:12.429469 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:12.429470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:12.429530 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:12.429814 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:12.429816 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:12.429816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:12.429935 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:12.430017 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:12.430322 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 01:14:12.430409 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 01:14:12.430671 23241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:12.421044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:34811 (local address 127.17.183.130:36483)
0812 01:14:12.421225 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:12.421265 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:12.421806 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:12.422006 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:12.422009 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:12.422555 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:12.422738 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:12.422743 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.423485 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.423486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:12.424752 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:12.424756 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.425103 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.425104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:12.425253 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:12.425771 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:12.425782 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:12.427406 (+ 1624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:12.429120 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:12.429129 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:12.429131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:12.429370 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:12.429622 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:12.429623 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:12.429623 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:12.429740 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:12.430020 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:12.430028 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:12.430177 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 01:14:12.430282 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 01:14:12.430436 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":112,"threads_started":1}
I20260812 01:14:12.431213 23235 heartbeater.cc:347] Connected to a master server at 127.17.183.190:34811
I20260812 01:14:12.431306 23235 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:12.431527 23235 heartbeater.cc:511] Master 127.17.183.190:34811 requested a full tablet report, sending...
I20260812 01:14:12.431949 22662 ts_manager.cc:194] Registered new tserver with Master: 483cdd5cfca242f4b2787e9015d40d7e (127.17.183.130:41169)
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
I20260812 01:14:12.432459 22662 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:36483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:14:12.450910 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34811
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:12.533876 23245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:12.534096 23245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:12.534121 23245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:12.535202 23245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:12.535238 23245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:12.535265 23245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:12.536840 23245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:12.537035 23245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:12.537211 23245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:12.542229 23251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:12.542311 23254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:12.542276 23250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:12.542626 23245 server_base.cc:1034] running on GCE node
I20260812 01:14:12.542826 23245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:12.543012 23245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:12.544145 23245 hybrid_clock.cc:648] HybridClock initialized: now 1786497252544136 us; error 26 us; skew 500 ppm
Aug 12 01:14:12 dist-test-slave-rwrg krb5kdc[22572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497252, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:12.546732 23245 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:14:12.547161 23245 webserver.cc:460] Webserver started at http://127.17.183.131:43285/ using document root <none> and password file <none>
I20260812 01:14:12.547362 23245 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:12.547399 23245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:12.547478 23245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:12.548436 23245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "9256d288a54747f391e9064dc571db82"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "7308f277f51ac38c7371d00bf4e3e767"
server_key_iv: "1e5385581c71f6cfd89f23d584ec878e"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.548893 23245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "9256d288a54747f391e9064dc571db82"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "7308f277f51ac38c7371d00bf4e3e767"
server_key_iv: "1e5385581c71f6cfd89f23d584ec878e"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.550150 23245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:12.550906 23268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:12.551103 23245 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:12.551198 23245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "9256d288a54747f391e9064dc571db82"
format_stamp: "Formatted at 2026-08-12 01:14:12 on dist-test-slave-rwrg"
server_key: "7308f277f51ac38c7371d00bf4e3e767"
server_key_iv: "1e5385581c71f6cfd89f23d584ec878e"
server_key_version: "encryptionkey@0"
I20260812 01:14:12.551265 23245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:12.564031 23245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:12.566248 23245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:12.566406 23245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:12.566624 23245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:12.566927 23245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:12.566982 23245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:12.567020 23245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:12.567047 23245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:12.573220 23245 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:32957
I20260812 01:14:12.573272 23494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:32957 every 8 connection(s)
I20260812 01:14:12.573531 23245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:12.575716 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 23245
I20260812 01:14:12.575819 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:12.576009 18142 external_mini_cluster.cc:1428] Setting key 5922d85ddf30e9a6595bfa21dec9cd4d
Aug 12 01:14:12 dist-test-slave-rwrg krb5kdc[22572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497252, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:12.583245 22730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:12.574280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:49275 (local address 127.17.183.190:34811)
0812 01:14:12.574475 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:12.574478 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:12.574654 (+ 176us) server_negotiation.cc:407] Connection header received
0812 01:14:12.575181 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:12.575182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:12.575195 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:12.575245 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:12.576331 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.576987 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.578001 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.578229 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.578309 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:12.580406 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:12.580408 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:12.580408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:12.580415 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:12.581870 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:12.582282 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:12.582284 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:12.582284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:12.582349 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:12.582613 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:12.582614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:12.582614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:12.582731 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:12.582802 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:12.583072 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 01:14:12.583150 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163}
I20260812 01:14:12.583441 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:12.574184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:34811 (local address 127.17.183.131:49275)
0812 01:14:12.574522 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:12.574571 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:12.575068 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:12.575340 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:12.575344 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:12.575966 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:12.576245 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:12.576251 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.577088 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.577089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:12.577898 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:12.577900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:12.578317 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:12.578319 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:12.578454 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:12.578942 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:12.578950 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:12.580300 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:12.581972 (+ 1672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:12.581980 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:12.581982 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:12.582202 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:12.582434 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:12.582435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:12.582435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:12.582541 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:12.582808 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:12.582815 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:12.582940 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 01:14:12.583038 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 01:14:12.583220 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":113,"threads_started":1}
I20260812 01:14:12.583855 23495 heartbeater.cc:347] Connected to a master server at 127.17.183.190:34811
I20260812 01:14:12.583930 23495 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:12.584146 23495 heartbeater.cc:511] Master 127.17.183.190:34811 requested a full tablet report, sending...
I20260812 01:14:12.584546 22662 ts_manager.cc:194] Registered new tserver with Master: 9256d288a54747f391e9064dc571db82 (127.17.183.131:32957)
I20260812 01:14:12.584988 22662 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:49275
I20260812 01:14:12.587776 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 01:14:12.599624 22730 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:12.598800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57650 (local address 127.17.183.190:34811)
0812 01:14:12.598859 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:12.598861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:12.598965 (+ 104us) server_negotiation.cc:407] Connection header received
0812 01:14:12.599022 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:12.599023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:12.599032 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:12.599075 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:12.599541 (+ 466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57650: BlockingRecv error: recv got EOF from 127.0.0.1:57650 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 01:14:12.600574 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 22769
I20260812 01:14:12.624096 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 22995
I20260812 01:14:12.632692 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 23245
I20260812 01:14:12.639228 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 22601
2026-08-12T01:14:12Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2237 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:12 dist-test-slave-rwrg krb5kdc[23520](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:12 dist-test-slave-rwrg krb5kdc[23520](info): set up 2 sockets
Aug 12 01:14:12 dist-test-slave-rwrg krb5kdc[23520](info): commencing operation
krb5kdc: starting...
W20260812 01:14:13.941246 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:14 dist-test-slave-rwrg krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:14:14.064532 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:35115
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:34979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:35115
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:14.147158 23547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:14.147363 23547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:14.147384 23547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:14.148458 23547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:14.148515 23547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:14.148531 23547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:14.148543 23547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:14.148555 23547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:14.150043 23547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:34979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:35115
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:35115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:14.150251 23547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:14.150421 23547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:14.155341 23559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:14.155344 23563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:14.155341 23560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:14.155704 23547 server_base.cc:1034] running on GCE node
I20260812 01:14:14.155953 23547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:14.156242 23547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:14.157488 23547 hybrid_clock.cc:648] HybridClock initialized: now 1786497254157465 us; error 46 us; skew 500 ppm
Aug 12 01:14:14 dist-test-slave-rwrg krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497254, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:14.166209 23547 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:14:14.166703 23547 webserver.cc:460] Webserver started at http://127.17.183.190:37665/ using document root <none> and password file <none>
I20260812 01:14:14.166960 23547 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:14.167026 23547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:14.167197 23547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:14.168253 23547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "ac0acf644f134b57b726676dbbe0622b"
format_stamp: "Formatted at 2026-08-12 01:14:14 on dist-test-slave-rwrg"
server_key: "967f13676e3b3b78630635b893713800"
server_key_iv: "67039fae8f10a5112689b1f81910d850"
server_key_version: "encryptionkey@0"
I20260812 01:14:14.168661 23547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "ac0acf644f134b57b726676dbbe0622b"
format_stamp: "Formatted at 2026-08-12 01:14:14 on dist-test-slave-rwrg"
server_key: "967f13676e3b3b78630635b893713800"
server_key_iv: "67039fae8f10a5112689b1f81910d850"
server_key_version: "encryptionkey@0"
I20260812 01:14:14.170019 23547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:14.170761 23576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:14.170936 23547 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:14.171046 23547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "ac0acf644f134b57b726676dbbe0622b"
format_stamp: "Formatted at 2026-08-12 01:14:14 on dist-test-slave-rwrg"
server_key: "967f13676e3b3b78630635b893713800"
server_key_iv: "67039fae8f10a5112689b1f81910d850"
server_key_version: "encryptionkey@0"
I20260812 01:14:14.171128 23547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:14.184469 23547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:14.186820 23547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:14.186985 23547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:14.191303 23547 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:35115
I20260812 01:14:14.191337 23675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:35115 every 8 connection(s)
I20260812 01:14:14.191874 23547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:14.192613 23678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:14.194991 23678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b: Bootstrap starting.
I20260812 01:14:14.195616 23678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:14.195940 23678 log.cc:824] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:14.196717 23678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b: No bootstrap required, opened a new log
I20260812 01:14:14.198342 23678 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0acf644f134b57b726676dbbe0622b" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35115 } }
I20260812 01:14:14.198486 23678 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:14.198510 23678 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac0acf644f134b57b726676dbbe0622b, State: Initialized, Role: FOLLOWER
I20260812 01:14:14.198683 23678 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0acf644f134b57b726676dbbe0622b" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35115 } }
I20260812 01:14:14.198750 23678 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:14.198805 23678 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:14.198855 23678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:14.199724 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 23547
I20260812 01:14:14.199853 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:14.200042 18142 external_mini_cluster.cc:1428] Setting key bc55394d44111152492c1f92b95b122a
I20260812 01:14:14.200048 23678 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0acf644f134b57b726676dbbe0622b" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35115 } }
I20260812 01:14:14.200152 23678 leader_election.cc:302] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac0acf644f134b57b726676dbbe0622b; no voters:
I20260812 01:14:14.200345 23678 leader_election.cc:288] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:14.200372 23681 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:14.200613 23681 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [term 1 LEADER]: Becoming Leader. State: Replica: ac0acf644f134b57b726676dbbe0622b, State: Running, Role: LEADER
I20260812 01:14:14.200681 23678 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:14.200768 23681 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0acf644f134b57b726676dbbe0622b" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35115 } }
I20260812 01:14:14.201116 23681 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac0acf644f134b57b726676dbbe0622b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0acf644f134b57b726676dbbe0622b" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35115 } } }
I20260812 01:14:14.201311 23681 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:14.201560 23681 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac0acf644f134b57b726676dbbe0622b. Latest consensus state: current_term: 1 leader_uuid: "ac0acf644f134b57b726676dbbe0622b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0acf644f134b57b726676dbbe0622b" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35115 } } }
I20260812 01:14:14.201678 23681 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:14.201738 23697 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:14.202334 23697 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:14.204030 23697 catalog_manager.cc:1347] Generated new cluster ID: 81aa3eb12c4a46e896dc7662b5b2a6c1
I20260812 01:14:14.204092 23697 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:14:14 dist-test-slave-rwrg krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:14.210843 23689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:14.200554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36740 (local address 127.17.183.190:35115)
0812 01:14:14.200858 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:14.200875 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:14.200907 (+ 32us) server_negotiation.cc:407] Connection header received
0812 01:14:14.201032 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:14.201037 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:14.201117 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:14.202139 (+ 1022us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:14.202282 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:14.203676 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:14.204599 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:14.205021 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:14.205138 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:14.207515 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:14.207519 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:14.207519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:14.207531 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:14.209300 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:14.209689 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:14.209692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:14.209692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:14.209799 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:14.210014 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:14.210015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:14.210015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:14.210247 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:14.210428 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:14.210504 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 01:14:14.210641 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":81,"threads_started":1}
I20260812 01:14:14.211802 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:14:14.239641 23689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:14.236018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36750 (local address 127.17.183.190:35115)
0812 01:14:14.236068 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:14.236071 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:14.236225 (+ 154us) server_negotiation.cc:407] Connection header received
0812 01:14:14.236313 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:14.236314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:14.236327 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:14.236418 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:14.236863 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:14.237343 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:14.238071 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:14.238291 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:14.238387 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:14.239127 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:14.239129 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:14.239129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:14.239340 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:14.239357 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:14.239364 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:14.239434 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:14.239503 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 01:14:14.239530 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:14:14.247180 23697 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:14.247768 23697 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:14.253229 23697 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac0acf644f134b57b726676dbbe0622b: Generated new TSK 0
I20260812 01:14:14.253459 23697 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:14:14.262378 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 23547
2026-08-12T01:14:14Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1628 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:14 dist-test-slave-rwrg krb5kdc[23734](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:14 dist-test-slave-rwrg krb5kdc[23734](info): set up 2 sockets
Aug 12 01:14:14 dist-test-slave-rwrg krb5kdc[23734](info): commencing operation
krb5kdc: starting...
W20260812 01:14:15.553135 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:15 dist-test-slave-rwrg krb5kdc[23734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:14:15.675014 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:34395
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:34395
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:15.763087 23759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:15.763306 23759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:15.763340 23759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:15.764396 23759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:15.764459 23759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:15.764480 23759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:15.764500 23759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:15.764581 23759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:15.766013 23759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:34395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:34395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:15.766296 23759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:15.766522 23759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:15.771281 23771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:15.771292 23770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:15.771297 23773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:15.771589 23759 server_base.cc:1034] running on GCE node
I20260812 01:14:15.771847 23759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:15.772152 23759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:15.773331 23759 hybrid_clock.cc:648] HybridClock initialized: now 1786497255773323 us; error 41 us; skew 500 ppm
Aug 12 01:14:15 dist-test-slave-rwrg krb5kdc[23734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497255, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:15.775897 23759 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:14:15.776451 23759 webserver.cc:460] Webserver started at http://127.17.183.190:46615/ using document root <none> and password file <none>
I20260812 01:14:15.776737 23759 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:15.776814 23759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:15.776965 23759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:15.778050 23759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "ff33e817178c41ed9fb02b766f916ccf"
format_stamp: "Formatted at 2026-08-12 01:14:15 on dist-test-slave-rwrg"
server_key: "0f37c8a9bda0fb3b51f3eb32040763f9"
server_key_iv: "ec6eaba5f74bb7b23308d8d9f1f45165"
server_key_version: "encryptionkey@0"
I20260812 01:14:15.778435 23759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "ff33e817178c41ed9fb02b766f916ccf"
format_stamp: "Formatted at 2026-08-12 01:14:15 on dist-test-slave-rwrg"
server_key: "0f37c8a9bda0fb3b51f3eb32040763f9"
server_key_iv: "ec6eaba5f74bb7b23308d8d9f1f45165"
server_key_version: "encryptionkey@0"
I20260812 01:14:15.779899 23759 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:15.780700 23795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:15.780874 23759 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:15.780982 23759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "ff33e817178c41ed9fb02b766f916ccf"
format_stamp: "Formatted at 2026-08-12 01:14:15 on dist-test-slave-rwrg"
server_key: "0f37c8a9bda0fb3b51f3eb32040763f9"
server_key_iv: "ec6eaba5f74bb7b23308d8d9f1f45165"
server_key_version: "encryptionkey@0"
I20260812 01:14:15.781055 23759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:15.795765 23759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:15.797549 23759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:15.797704 23759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:15.802193 23759 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:34395
I20260812 01:14:15.802225 23893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:34395 every 8 connection(s)
I20260812 01:14:15.802601 23759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:15.803620 23894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:15.805912 23894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf: Bootstrap starting.
I20260812 01:14:15.806461 23894 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:15.806694 23894 log.cc:824] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:15.807354 23894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf: No bootstrap required, opened a new log
I20260812 01:14:15.808897 23894 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff33e817178c41ed9fb02b766f916ccf" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34395 } }
I20260812 01:14:15.809034 23894 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:15.809067 23894 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff33e817178c41ed9fb02b766f916ccf, State: Initialized, Role: FOLLOWER
I20260812 01:14:15.809206 23894 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff33e817178c41ed9fb02b766f916ccf" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34395 } }
I20260812 01:14:15.809312 23894 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:15.809337 23894 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:15.809367 23894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:15.810122 23894 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff33e817178c41ed9fb02b766f916ccf" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34395 } }
I20260812 01:14:15.810210 23894 leader_election.cc:302] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff33e817178c41ed9fb02b766f916ccf; no voters:
I20260812 01:14:15.810340 23894 leader_election.cc:288] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:15.810386 23900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:15.810616 23900 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [term 1 LEADER]: Becoming Leader. State: Replica: ff33e817178c41ed9fb02b766f916ccf, State: Running, Role: LEADER
I20260812 01:14:15.810667 23894 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:15.810688 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 23759
I20260812 01:14:15.810720 23900 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff33e817178c41ed9fb02b766f916ccf" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34395 } }
I20260812 01:14:15.810799 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:15.811007 18142 external_mini_cluster.cc:1428] Setting key 251de283978ad1117bd9c1182e2d49d3
I20260812 01:14:15.811023 23900 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff33e817178c41ed9fb02b766f916ccf. Latest consensus state: current_term: 1 leader_uuid: "ff33e817178c41ed9fb02b766f916ccf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff33e817178c41ed9fb02b766f916ccf" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34395 } } }
I20260812 01:14:15.811033 23901 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff33e817178c41ed9fb02b766f916ccf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff33e817178c41ed9fb02b766f916ccf" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34395 } } }
I20260812 01:14:15.811101 23900 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:15.811116 23901 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:15.811317 23908 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:15.812022 23908 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:15.813784 23908 catalog_manager.cc:1347] Generated new cluster ID: 970df0de59ea41fbb239ba54dcaa48f2
I20260812 01:14:15.813838 23908 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:14:15 dist-test-slave-rwrg krb5kdc[23734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:15.823112 23928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:15.811802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36676 (local address 127.17.183.190:34395)
0812 01:14:15.811961 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:15.811970 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:15.812208 (+ 238us) server_negotiation.cc:407] Connection header received
0812 01:14:15.812754 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:15.812763 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:15.812822 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:15.812980 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:15.813788 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:15.815087 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:15.816088 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:15.816731 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:15.816853 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:15.819608 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:15.819612 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:15.819612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:15.819623 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:15.821500 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:15.821894 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:15.821897 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:15.821897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:15.822003 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:15.822242 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:15.822243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:15.822243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:15.822526 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:15.822641 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:15.822778 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 01:14:15.822898 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":86,"threads_started":1}
I20260812 01:14:15.824958 23908 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:15.825672 23908 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:15.832734 23908 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff33e817178c41ed9fb02b766f916ccf: Generated new TSK 0
I20260812 01:14:15.832913 23908 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:14:15.864910 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34395
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:15.958907 23939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:15.959115 23939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:15.959137 23939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:15.960358 23939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:15.960398 23939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:15.960424 23939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:15.961989 23939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:15.962280 23939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:15.962543 23939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:15.968243 23954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:15.968240 23957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:15.968238 23952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:15.968586 23939 server_base.cc:1034] running on GCE node
I20260812 01:14:15.968819 23939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:15.969075 23939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:15.970244 23939 hybrid_clock.cc:648] HybridClock initialized: now 1786497255970228 us; error 34 us; skew 500 ppm
Aug 12 01:14:15 dist-test-slave-rwrg krb5kdc[23734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497255, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:15.972702 23939 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:14:15.973227 23939 webserver.cc:460] Webserver started at http://127.17.183.129:46193/ using document root <none> and password file <none>
I20260812 01:14:15.973482 23939 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:15.973556 23939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:15.973711 23939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:15.974767 23939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "3e2ea28cf19742bd850fc1efd497bd41"
format_stamp: "Formatted at 2026-08-12 01:14:15 on dist-test-slave-rwrg"
server_key: "cbd3b5aeb1a14b924b6c7b59dbf8faa8"
server_key_iv: "084512cce575a749eb3ed94d95a3e84f"
server_key_version: "encryptionkey@0"
I20260812 01:14:15.975127 23939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "3e2ea28cf19742bd850fc1efd497bd41"
format_stamp: "Formatted at 2026-08-12 01:14:15 on dist-test-slave-rwrg"
server_key: "cbd3b5aeb1a14b924b6c7b59dbf8faa8"
server_key_iv: "084512cce575a749eb3ed94d95a3e84f"
server_key_version: "encryptionkey@0"
I20260812 01:14:15.976426 23939 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:15.977233 23971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:15.977398 23939 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:15.977496 23939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "3e2ea28cf19742bd850fc1efd497bd41"
format_stamp: "Formatted at 2026-08-12 01:14:15 on dist-test-slave-rwrg"
server_key: "cbd3b5aeb1a14b924b6c7b59dbf8faa8"
server_key_iv: "084512cce575a749eb3ed94d95a3e84f"
server_key_version: "encryptionkey@0"
I20260812 01:14:15.977581 23939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:15.990022 23939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:15.991816 23939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:15.991979 23939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:15.992197 23939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:15.992539 23939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:15.992601 23939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:15.992641 23939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:15.992667 23939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:15.999006 23939 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:35717
I20260812 01:14:15.999061 24186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:35717 every 8 connection(s)
I20260812 01:14:15.999373 23939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:14:16.000901 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 23939
I20260812 01:14:16.001016 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:16.001205 18142 external_mini_cluster.cc:1428] Setting key e1f99f849b8b61b861465173f1d2d082
Aug 12 01:14:16 dist-test-slave-rwrg krb5kdc[23734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497255, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:16.009577 23928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:16.000039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:55699 (local address 127.17.183.190:34395)
0812 01:14:16.000207 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:16.000210 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:16.000397 (+ 187us) server_negotiation.cc:407] Connection header received
0812 01:14:16.001028 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:16.001029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:16.001046 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:16.001096 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:16.002143 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.002931 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.003910 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.004149 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.004230 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:16.006686 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:16.006687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:16.006688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:16.006696 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:16.008086 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:16.008557 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:16.008558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:16.008558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:16.008623 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:16.008884 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:16.008885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:16.008885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:16.009003 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:16.009079 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:16.009380 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 01:14:16.009485 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260812 01:14:16.009748 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:16.000018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:34395 (local address 127.17.183.129:55699)
0812 01:14:16.000253 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:16.000307 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:16.000903 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:16.001220 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:16.001224 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:16.001851 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:16.002038 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:16.002044 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.003030 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.003031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:16.003806 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:16.003808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.004240 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.004242 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:16.004397 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:16.004972 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:16.004980 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:16.006568 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:16.008191 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:16.008199 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:16.008201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:16.008435 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:16.008700 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:16.008701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:16.008701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:16.008812 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:16.009082 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:16.009090 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:16.009226 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 01:14:16.009342 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 01:14:16.009502 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
I20260812 01:14:16.010265 24188 heartbeater.cc:347] Connected to a master server at 127.17.183.190:34395
I20260812 01:14:16.010378 24188 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:16.010589 24188 heartbeater.cc:511] Master 127.17.183.190:34395 requested a full tablet report, sending...
I20260812 01:14:16.011198 23825 ts_manager.cc:194] Registered new tserver with Master: 3e2ea28cf19742bd850fc1efd497bd41 (127.17.183.129:35717)
I20260812 01:14:16.011906 23825 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:55699
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:14:16.027891 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34395
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:16.110940 24196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:16.111176 24196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:16.111217 24196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:16.112566 24196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:16.112625 24196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:16.112670 24196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:16.114140 24196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:16.114398 24196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:16.114645 24196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:16.119756 24209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:16.119796 24196 server_base.cc:1034] running on GCE node
W20260812 01:14:16.119725 24211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:16.119724 24207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:16.120144 24196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:16.120333 24196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:16.121467 24196 hybrid_clock.cc:648] HybridClock initialized: now 1786497256121443 us; error 42 us; skew 500 ppm
Aug 12 01:14:16 dist-test-slave-rwrg krb5kdc[23734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497256, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:16.123840 24196 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:14:16.124279 24196 webserver.cc:460] Webserver started at http://127.17.183.130:42065/ using document root <none> and password file <none>
I20260812 01:14:16.124460 24196 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:16.124552 24196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:16.124657 24196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:16.125725 24196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "d423da161b3946b29f6c855cffd9d99d"
format_stamp: "Formatted at 2026-08-12 01:14:16 on dist-test-slave-rwrg"
server_key: "e10c8baaa96efb67e05633cff508d225"
server_key_iv: "1f143c0896791ccaf6cdc77982f32872"
server_key_version: "encryptionkey@0"
I20260812 01:14:16.126016 24196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "d423da161b3946b29f6c855cffd9d99d"
format_stamp: "Formatted at 2026-08-12 01:14:16 on dist-test-slave-rwrg"
server_key: "e10c8baaa96efb67e05633cff508d225"
server_key_iv: "1f143c0896791ccaf6cdc77982f32872"
server_key_version: "encryptionkey@0"
I20260812 01:14:16.127281 24196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 01:14:16.127938 24223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:16.128120 24196 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:16.128226 24196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "d423da161b3946b29f6c855cffd9d99d"
format_stamp: "Formatted at 2026-08-12 01:14:16 on dist-test-slave-rwrg"
server_key: "e10c8baaa96efb67e05633cff508d225"
server_key_iv: "1f143c0896791ccaf6cdc77982f32872"
server_key_version: "encryptionkey@0"
I20260812 01:14:16.128298 24196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:16.143746 24196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:16.145643 24196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:16.145799 24196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:16.146023 24196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:16.146334 24196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:16.146385 24196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:16.146426 24196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:16.146462 24196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:16.152684 24196 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:35441
I20260812 01:14:16.152741 24440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:35441 every 8 connection(s)
I20260812 01:14:16.153038 24196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:16.153512 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 24196
I20260812 01:14:16.153633 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:16.153903 18142 external_mini_cluster.cc:1428] Setting key cb26a1808344d14dca7c19e5df22f80f
Aug 12 01:14:16 dist-test-slave-rwrg krb5kdc[23734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497256, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
I20260812 01:14:16.163941 23928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:16.153844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:55387 (local address 127.17.183.190:34395)
0812 01:14:16.153919 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:16.153922 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:16.154131 (+ 209us) server_negotiation.cc:407] Connection header received
0812 01:14:16.154786 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:16.154788 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:16.154801 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:16.154878 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:16.155818 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.156581 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.158004 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.158328 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.158400 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:16.160915 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:16.160917 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:16.160917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:16.160926 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:16.162453 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:16.162875 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:16.162876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:16.162877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:16.162939 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:16.163212 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:16.163213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:16.163213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:16.163365 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:16.163438 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:16.163745 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 01:14:16.163850 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 01:14:16.164110 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:16.153820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:34395 (local address 127.17.183.130:55387)
0812 01:14:16.153986 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:16.154029 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:16.154681 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:16.154948 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:16.154951 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:16.155493 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:16.155702 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:16.155707 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.156682 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.156684 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:16.157914 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:16.157917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.158423 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.158424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:16.158539 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:16.159109 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:16.159117 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:16.160818 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:16.162556 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:16.162565 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:16.162567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:16.162799 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:16.163033 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:16.163034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:16.163034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:16.163144 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:16.163440 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:16.163448 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:16.163579 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 01:14:16.163690 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 01:14:16.163861 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260812 01:14:16.164635 24442 heartbeater.cc:347] Connected to a master server at 127.17.183.190:34395
I20260812 01:14:16.164783 24442 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:16.164966 24442 heartbeater.cc:511] Master 127.17.183.190:34395 requested a full tablet report, sending...
I20260812 01:14:16.165395 23825 ts_manager.cc:194] Registered new tserver with Master: d423da161b3946b29f6c855cffd9d99d (127.17.183.130:35441)
I20260812 01:14:16.165737 23825 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:55387
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:14:16.182554 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34395
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:16.268334 24453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:16.268640 24453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:16.268671 24453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:16.269795 24453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:16.269837 24453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:16.269865 24453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:16.271260 24453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:16.271443 24453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:16.271636 24453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:16.276834 24458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:16.276858 24462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:16.276862 24459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:16.277078 24453 server_base.cc:1034] running on GCE node
I20260812 01:14:16.277271 24453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:16.277460 24453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:16.278604 24453 hybrid_clock.cc:648] HybridClock initialized: now 1786497256278591 us; error 29 us; skew 500 ppm
Aug 12 01:14:16 dist-test-slave-rwrg krb5kdc[23734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497256, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:16.281453 24453 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:14:16.281893 24453 webserver.cc:460] Webserver started at http://127.17.183.131:41883/ using document root <none> and password file <none>
I20260812 01:14:16.282147 24453 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:16.282217 24453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:16.282364 24453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:16.283380 24453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "b2f7da6993c54099bacd9a2413447dbf"
format_stamp: "Formatted at 2026-08-12 01:14:16 on dist-test-slave-rwrg"
server_key: "3efc2eb52df9e8eadf30a1b366497e96"
server_key_iv: "ab62042717ca7b8a5219af9ab0fc38d5"
server_key_version: "encryptionkey@0"
I20260812 01:14:16.283744 24453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "b2f7da6993c54099bacd9a2413447dbf"
format_stamp: "Formatted at 2026-08-12 01:14:16 on dist-test-slave-rwrg"
server_key: "3efc2eb52df9e8eadf30a1b366497e96"
server_key_iv: "ab62042717ca7b8a5219af9ab0fc38d5"
server_key_version: "encryptionkey@0"
I20260812 01:14:16.285122 24453 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:16.285830 24480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:16.286010 24453 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:16.286115 24453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "b2f7da6993c54099bacd9a2413447dbf"
format_stamp: "Formatted at 2026-08-12 01:14:16 on dist-test-slave-rwrg"
server_key: "3efc2eb52df9e8eadf30a1b366497e96"
server_key_iv: "ab62042717ca7b8a5219af9ab0fc38d5"
server_key_version: "encryptionkey@0"
I20260812 01:14:16.286194 24453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:16.304042 24453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:16.306329 24453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:16.306488 24453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:16.306728 24453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:16.307024 24453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:16.307075 24453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:16.307108 24453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:16.307168 24453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:16.313795 24453 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:40739
I20260812 01:14:16.313840 24699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:40739 every 8 connection(s)
I20260812 01:14:16.314150 24453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:16.318244 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 24453
I20260812 01:14:16.318348 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:16.318576 18142 external_mini_cluster.cc:1428] Setting key 14d6049f07d3c2c0f51a8b994c6354bc
Aug 12 01:14:16 dist-test-slave-rwrg krb5kdc[23734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497256, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:16.323346 23928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:16.314885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:52383 (local address 127.17.183.190:34395)
0812 01:14:16.314963 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:16.314965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:16.315147 (+ 182us) server_negotiation.cc:407] Connection header received
0812 01:14:16.315625 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:16.315626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:16.315636 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:16.315683 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:16.316751 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.317217 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.318148 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.318459 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.318547 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:16.320817 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:16.320818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:16.320818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:16.320825 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:16.322163 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:16.322503 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:16.322504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:16.322504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:16.322552 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:16.322762 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:16.322763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:16.322763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:16.322856 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:16.322906 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:16.323174 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 01:14:16.323257 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 01:14:16.323529 24707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:16.314847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:34395 (local address 127.17.183.131:52383)
0812 01:14:16.315027 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:16.315062 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:16.315529 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:16.315743 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:16.315747 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:16.316417 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:16.316673 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:16.316679 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.317297 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.317298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:16.318063 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:16.318065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.318573 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.318574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:16.318725 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:16.319166 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:16.319194 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:16.320739 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:16.322231 (+ 1492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:16.322242 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:16.322244 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:16.322440 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:16.322618 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:16.322618 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:16.322618 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:16.322712 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:16.322911 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:16.322916 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:16.323020 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 01:14:16.323142 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 01:14:16.323307 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":94,"threads_started":1}
I20260812 01:14:16.323972 24700 heartbeater.cc:347] Connected to a master server at 127.17.183.190:34395
I20260812 01:14:16.324071 24700 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:16.324261 24700 heartbeater.cc:511] Master 127.17.183.190:34395 requested a full tablet report, sending...
I20260812 01:14:16.324676 23825 ts_manager.cc:194] Registered new tserver with Master: b2f7da6993c54099bacd9a2413447dbf (127.17.183.131:40739)
I20260812 01:14:16.325065 23825 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:52383
I20260812 01:14:16.330636 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 01:14:16 dist-test-slave-rwrg krb5kdc[23734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497256, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 01:14:16 dist-test-slave-rwrg krb5kdc[23734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497256, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:16.354440 23928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:16.347627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36690 (local address 127.17.183.190:34395)
0812 01:14:16.347710 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:16.347712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:16.347792 (+ 80us) server_negotiation.cc:407] Connection header received
0812 01:14:16.347847 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:16.347847 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:16.347858 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:16.347909 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:16.348531 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.349023 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.349752 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:16.349928 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:16.349977 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:16.352117 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:16.352119 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:16.352119 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:16.352126 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:16.353425 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:16.353733 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:16.353733 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:16.353734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:16.353782 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:16.353948 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:16.353948 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:16.353949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:16.354099 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:16.354178 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:16.354288 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 01:14:16.354347 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 01:14:16.354728 23825 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36690
I20260812 01:14:16.355163 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 23939
I20260812 01:14:16.386818 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 24196
I20260812 01:14:16.403836 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 24453
I20260812 01:14:16.422977 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 23759
2026-08-12T01:14:16Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2163 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:16 dist-test-slave-rwrg krb5kdc[24725](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:16 dist-test-slave-rwrg krb5kdc[24725](info): set up 2 sockets
Aug 12 01:14:16 dist-test-slave-rwrg krb5kdc[24725](info): commencing operation
krb5kdc: starting...
W20260812 01:14:17.724697 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:17 dist-test-slave-rwrg krb5kdc[24725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:14:17.845497 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:38933
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:38933
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:17.927336 24747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:17.927577 24747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:17.927613 24747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:17.928804 24747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:17.928874 24747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:17.928898 24747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:17.928920 24747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:17.928947 24747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:17.930505 24747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:38933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:38933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:17.930804 24747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:17.931047 24747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:17.935797 24753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:17.935845 24754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:17.935793 24759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:17.936095 24747 server_base.cc:1034] running on GCE node
I20260812 01:14:17.936360 24747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:17.936693 24747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:17.937873 24747 hybrid_clock.cc:648] HybridClock initialized: now 1786497257937865 us; error 34 us; skew 500 ppm
Aug 12 01:14:17 dist-test-slave-rwrg krb5kdc[24725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497257, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:17.940428 24747 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:14:17.940891 24747 webserver.cc:460] Webserver started at http://127.17.183.190:34875/ using document root <none> and password file <none>
I20260812 01:14:17.941143 24747 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:17.941190 24747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:17.941349 24747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:17.942389 24747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "f1baf6aa406848fea6553fbe440d1905"
format_stamp: "Formatted at 2026-08-12 01:14:17 on dist-test-slave-rwrg"
server_key: "bd3441175913afd61c89d9cf0893bec7"
server_key_iv: "8ed59cca6a1753b70aedcc4e5818ffa5"
server_key_version: "encryptionkey@0"
I20260812 01:14:17.942729 24747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "f1baf6aa406848fea6553fbe440d1905"
format_stamp: "Formatted at 2026-08-12 01:14:17 on dist-test-slave-rwrg"
server_key: "bd3441175913afd61c89d9cf0893bec7"
server_key_iv: "8ed59cca6a1753b70aedcc4e5818ffa5"
server_key_version: "encryptionkey@0"
I20260812 01:14:17.944047 24747 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:17.944893 24775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:17.945073 24747 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:17.945159 24747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "f1baf6aa406848fea6553fbe440d1905"
format_stamp: "Formatted at 2026-08-12 01:14:17 on dist-test-slave-rwrg"
server_key: "bd3441175913afd61c89d9cf0893bec7"
server_key_iv: "8ed59cca6a1753b70aedcc4e5818ffa5"
server_key_version: "encryptionkey@0"
I20260812 01:14:17.945212 24747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:17.974666 24747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:17.976696 24747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:17.976814 24747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:17.980852 24747 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:38933
I20260812 01:14:17.980908 24869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:38933 every 8 connection(s)
I20260812 01:14:17.981442 24747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:17.982133 24871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:17.984484 24871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905: Bootstrap starting.
I20260812 01:14:17.985140 24871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:17.985409 24871 log.cc:824] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:17.986101 24871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905: No bootstrap required, opened a new log
I20260812 01:14:17.987663 24871 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1baf6aa406848fea6553fbe440d1905" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38933 } }
I20260812 01:14:17.987805 24871 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:17.987828 24871 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1baf6aa406848fea6553fbe440d1905, State: Initialized, Role: FOLLOWER
I20260812 01:14:17.987934 24871 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1baf6aa406848fea6553fbe440d1905" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38933 } }
I20260812 01:14:17.988015 24871 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:17.988052 24871 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:17.988128 24871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:17.989169 24871 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1baf6aa406848fea6553fbe440d1905" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38933 } }
I20260812 01:14:17.989307 24871 leader_election.cc:302] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1baf6aa406848fea6553fbe440d1905; no voters:
I20260812 01:14:17.989495 24871 leader_election.cc:288] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:17.989545 24880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:17.989759 24880 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [term 1 LEADER]: Becoming Leader. State: Replica: f1baf6aa406848fea6553fbe440d1905, State: Running, Role: LEADER
I20260812 01:14:17.989777 24871 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:17.989878 24880 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1baf6aa406848fea6553fbe440d1905" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38933 } }
I20260812 01:14:17.990315 24881 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1baf6aa406848fea6553fbe440d1905" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1baf6aa406848fea6553fbe440d1905" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38933 } } }
I20260812 01:14:17.990408 24881 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:17.990545 24883 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1baf6aa406848fea6553fbe440d1905. Latest consensus state: current_term: 1 leader_uuid: "f1baf6aa406848fea6553fbe440d1905" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1baf6aa406848fea6553fbe440d1905" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38933 } } }
I20260812 01:14:17.990649 24893 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:17.990666 24883 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:17.990972 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 24747
I20260812 01:14:17.991076 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:17.991266 18142 external_mini_cluster.cc:1428] Setting key 971e6b3d733985fc36a3f3e522b994ed
I20260812 01:14:17.991204 24893 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:17.993604 24893 catalog_manager.cc:1347] Generated new cluster ID: 1fce7f6696834d28b75647516cfe38c4
I20260812 01:14:17.993669 24893 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:14:17 dist-test-slave-rwrg krb5kdc[24725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:18.003214 24893 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:18.003712 24893 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:18.003973 24916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:17.991794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57330 (local address 127.17.183.190:38933)
0812 01:14:17.992002 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:17.992014 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:17.992106 (+ 92us) server_negotiation.cc:407] Connection header received
0812 01:14:17.992623 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:17.992631 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:17.992690 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:17.992839 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:17.993596 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:17.995109 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:17.996191 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:17.996858 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:17.998794 (+ 1936us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:17.999837 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:17.999841 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:17.999842 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:17.999854 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:18.001956 (+ 2102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.002382 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.002385 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.002385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.002504 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.002759 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.002760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.002761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.002983 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:18.003158 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:18.003580 (+ 422us) server_negotiation.cc:299] Negotiation successful
0812 01:14:18.003740 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":153,"thread_start_us":93,"threads_started":1}
I20260812 01:14:18.012931 24893 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1baf6aa406848fea6553fbe440d1905: Generated new TSK 0
I20260812 01:14:18.013131 24893 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:14:18.042994 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38933
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:18.127380 24923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:18.127595 24923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:18.127619 24923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:18.128846 24923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:18.128890 24923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:18.128916 24923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:18.130435 24923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:18.130668 24923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:18.130880 24923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:18.135921 24941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:18.135907 24933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:18.135907 24934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:18.136138 24923 server_base.cc:1034] running on GCE node
I20260812 01:14:18.136322 24923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:18.136602 24923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:18.137749 24923 hybrid_clock.cc:648] HybridClock initialized: now 1786497258137739 us; error 27 us; skew 500 ppm
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[24725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497258, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:18.140180 24923 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:14:18.140676 24923 webserver.cc:460] Webserver started at http://127.17.183.129:32961/ using document root <none> and password file <none>
I20260812 01:14:18.140926 24923 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:18.140990 24923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:18.141141 24923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:18.142184 24923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "38c2005b7c4d4d35b162fe152487c9f4"
format_stamp: "Formatted at 2026-08-12 01:14:18 on dist-test-slave-rwrg"
server_key: "cc421fdbbd58baf65c213e01eb014024"
server_key_iv: "f9a9c53b77ec1823ef3290fe21c8a70c"
server_key_version: "encryptionkey@0"
I20260812 01:14:18.142547 24923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "38c2005b7c4d4d35b162fe152487c9f4"
format_stamp: "Formatted at 2026-08-12 01:14:18 on dist-test-slave-rwrg"
server_key: "cc421fdbbd58baf65c213e01eb014024"
server_key_iv: "f9a9c53b77ec1823ef3290fe21c8a70c"
server_key_version: "encryptionkey@0"
I20260812 01:14:18.143877 24923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:18.144608 24951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:18.144814 24923 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:18.144918 24923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "38c2005b7c4d4d35b162fe152487c9f4"
format_stamp: "Formatted at 2026-08-12 01:14:18 on dist-test-slave-rwrg"
server_key: "cc421fdbbd58baf65c213e01eb014024"
server_key_iv: "f9a9c53b77ec1823ef3290fe21c8a70c"
server_key_version: "encryptionkey@0"
I20260812 01:14:18.145004 24923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:18.156934 24923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:18.158838 24923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:18.159000 24923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:18.159250 24923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:18.159569 24923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:18.159631 24923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:18.159674 24923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:18.159704 24923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:18.165817 24923 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:36037
I20260812 01:14:18.165874 25179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:36037 every 8 connection(s)
I20260812 01:14:18.166177 24923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:14:18.168704 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 24923
I20260812 01:14:18.168826 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:18.169261 18142 external_mini_cluster.cc:1428] Setting key e66835f1977290dc760b142bc12b6a0e
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[24725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497258, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:18.176856 24916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:18.166990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:48413 (local address 127.17.183.190:38933)
0812 01:14:18.167058 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:18.167060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:18.167315 (+ 255us) server_negotiation.cc:407] Connection header received
0812 01:14:18.168254 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:18.168255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:18.168266 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:18.168322 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:18.169172 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.169917 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.170947 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.171285 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.171373 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:18.173795 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:18.173796 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:18.173797 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:18.173805 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:18.175455 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.175841 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.175842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.175843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.175911 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.176138 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.176139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.176140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.176292 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:18.176370 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:18.176647 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 01:14:18.176749 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 01:14:18.176878 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:18.166997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:38933 (local address 127.17.183.129:48413)
0812 01:14:18.167193 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:18.167230 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:18.168168 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:18.168399 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:18.168403 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:18.168740 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:18.169018 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:18.169024 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.170011 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.170012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:18.170851 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:18.170854 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.171376 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.171378 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:18.171513 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:18.172078 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:18.172087 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:18.173701 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:18.175538 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:18.175545 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:18.175547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:18.175765 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:18.175982 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:18.175982 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:18.175983 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:18.176076 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:18.176362 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:18.176367 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:18.176476 (+ 109us) client_negotiation.cc:769] Sending connection context
0812 01:14:18.176604 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 01:14:18.176722 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":107,"threads_started":1}
I20260812 01:14:18.177434 25180 heartbeater.cc:347] Connected to a master server at 127.17.183.190:38933
I20260812 01:14:18.177542 25180 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:18.177721 25180 heartbeater.cc:511] Master 127.17.183.190:38933 requested a full tablet report, sending...
I20260812 01:14:18.178267 24802 ts_manager.cc:194] Registered new tserver with Master: 38c2005b7c4d4d35b162fe152487c9f4 (127.17.183.129:36037)
I20260812 01:14:18.178861 24802 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:48413
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:14:18.197311 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38933
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:18.279325 25194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:18.279526 25194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:18.279549 25194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:18.280714 25194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:18.280754 25194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:18.280803 25194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:18.282356 25194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:18.282598 25194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:18.282827 25194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:18.287690 25207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:18.287736 25214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:18.287690 25205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:18.287923 25194 server_base.cc:1034] running on GCE node
I20260812 01:14:18.288144 25194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:18.288363 25194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:18.289520 25194 hybrid_clock.cc:648] HybridClock initialized: now 1786497258289501 us; error 45 us; skew 500 ppm
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[24725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497258, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:18.292079 25194 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:14:18.292562 25194 webserver.cc:460] Webserver started at http://127.17.183.130:42895/ using document root <none> and password file <none>
I20260812 01:14:18.292794 25194 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:18.292857 25194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:18.293009 25194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:18.293995 25194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "19a7023f6d034482885c1bf00f8b6a70"
format_stamp: "Formatted at 2026-08-12 01:14:18 on dist-test-slave-rwrg"
server_key: "c179cc2e140f75a4c3744f482d64e30f"
server_key_iv: "8e300763d2d4026d7960da23e38d28dd"
server_key_version: "encryptionkey@0"
I20260812 01:14:18.294343 25194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "19a7023f6d034482885c1bf00f8b6a70"
format_stamp: "Formatted at 2026-08-12 01:14:18 on dist-test-slave-rwrg"
server_key: "c179cc2e140f75a4c3744f482d64e30f"
server_key_iv: "8e300763d2d4026d7960da23e38d28dd"
server_key_version: "encryptionkey@0"
I20260812 01:14:18.295661 25194 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:18.296355 25228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:18.296556 25194 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:18.296684 25194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "19a7023f6d034482885c1bf00f8b6a70"
format_stamp: "Formatted at 2026-08-12 01:14:18 on dist-test-slave-rwrg"
server_key: "c179cc2e140f75a4c3744f482d64e30f"
server_key_iv: "8e300763d2d4026d7960da23e38d28dd"
server_key_version: "encryptionkey@0"
I20260812 01:14:18.296765 25194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:18.304848 25194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:18.306428 25194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:18.306568 25194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:18.306766 25194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:18.307034 25194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:18.307080 25194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:18.307107 25194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:18.307135 25194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:18.313205 25194 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:42175
I20260812 01:14:18.313256 25437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:42175 every 8 connection(s)
I20260812 01:14:18.313537 25194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[24725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497258, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:18.322357 24916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:18.314208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:50963 (local address 127.17.183.190:38933)
0812 01:14:18.314270 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:18.314272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:18.314477 (+ 205us) server_negotiation.cc:407] Connection header received
0812 01:14:18.315421 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:18.315422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:18.315435 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:18.315481 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:18.316057 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.316624 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.317546 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.317732 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.317796 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:18.319769 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:18.319770 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:18.319771 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:18.319779 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:18.321044 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.321453 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.321455 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.321455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.321509 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.321752 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.321753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.321753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.321859 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:18.321924 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:18.322190 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 01:14:18.322268 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 01:14:18.322527 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:18.314164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:38933 (local address 127.17.183.130:50963)
0812 01:14:18.314352 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:18.314391 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:18.315307 (+ 916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:18.315557 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:18.315561 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:18.315800 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:18.315966 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:18.315970 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.316713 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.316714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:18.317453 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:18.317455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.317806 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.317807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:18.317920 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:18.318329 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:18.318337 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:18.319676 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:18.321152 (+ 1476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:18.321158 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:18.321160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:18.321368 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:18.321573 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:18.321573 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:18.321574 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:18.321681 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:18.321928 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:18.321935 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:18.322061 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 01:14:18.322168 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 01:14:18.322317 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":108,"threads_started":1}
I20260812 01:14:18.322556 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 25194
I20260812 01:14:18.322659 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:18.322863 18142 external_mini_cluster.cc:1428] Setting key eb53e6043e255f8ee95e6562074ec925
I20260812 01:14:18.323192 25438 heartbeater.cc:347] Connected to a master server at 127.17.183.190:38933
I20260812 01:14:18.323311 25438 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:18.323521 25438 heartbeater.cc:511] Master 127.17.183.190:38933 requested a full tablet report, sending...
I20260812 01:14:18.323937 24802 ts_manager.cc:194] Registered new tserver with Master: 19a7023f6d034482885c1bf00f8b6a70 (127.17.183.130:42175)
I20260812 01:14:18.324316 24802 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:50963
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:14:18.349376 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38933
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:18.433634 25446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:18.433955 25446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:18.434000 25446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:18.435694 25446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:18.435760 25446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:18.435807 25446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:18.437600 25446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:18.437794 25446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:18.437992 25446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:18.443233 25456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:18.443286 25460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:18.443297 25458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:18.443473 25446 server_base.cc:1034] running on GCE node
I20260812 01:14:18.443647 25446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:18.443851 25446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:18.444988 25446 hybrid_clock.cc:648] HybridClock initialized: now 1786497258444973 us; error 29 us; skew 500 ppm
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[24725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497258, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:18.447585 25446 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:14:18.448113 25446 webserver.cc:460] Webserver started at http://127.17.183.131:40775/ using document root <none> and password file <none>
I20260812 01:14:18.448410 25446 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:18.448470 25446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:18.448668 25446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:18.449826 25446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "c2efa8ca051b4225851e558b06b90c3f"
format_stamp: "Formatted at 2026-08-12 01:14:18 on dist-test-slave-rwrg"
server_key: "6159c30a3fc91ccfde2adfc907b06a70"
server_key_iv: "e06dba87cb84d4a8f190826254cf8e50"
server_key_version: "encryptionkey@0"
I20260812 01:14:18.450222 25446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "c2efa8ca051b4225851e558b06b90c3f"
format_stamp: "Formatted at 2026-08-12 01:14:18 on dist-test-slave-rwrg"
server_key: "6159c30a3fc91ccfde2adfc907b06a70"
server_key_iv: "e06dba87cb84d4a8f190826254cf8e50"
server_key_version: "encryptionkey@0"
I20260812 01:14:18.451651 25446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:18.452438 25470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:18.452678 25446 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:18.452764 25446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "c2efa8ca051b4225851e558b06b90c3f"
format_stamp: "Formatted at 2026-08-12 01:14:18 on dist-test-slave-rwrg"
server_key: "6159c30a3fc91ccfde2adfc907b06a70"
server_key_iv: "e06dba87cb84d4a8f190826254cf8e50"
server_key_version: "encryptionkey@0"
I20260812 01:14:18.452844 25446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:18.464757 25446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:18.466913 25446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:18.467041 25446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:18.467269 25446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:18.467574 25446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:18.467607 25446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:18.467628 25446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:18.467669 25446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:18.473953 25446 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:38395
I20260812 01:14:18.474004 25675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:38395 every 8 connection(s)
I20260812 01:14:18.474316 25446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:18.474756 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 25446
I20260812 01:14:18.474877 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:18.475117 18142 external_mini_cluster.cc:1428] Setting key 4b73e92015e336e5f400f5e32d9a405a
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[24725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497258, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:18.483773 24916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:18.474997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:60679 (local address 127.17.183.190:38933)
0812 01:14:18.475076 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:18.475079 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:18.475336 (+ 257us) server_negotiation.cc:407] Connection header received
0812 01:14:18.476574 (+ 1238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:18.476575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:18.476599 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:18.476645 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:18.477252 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.477726 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.479216 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.479400 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.479457 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:18.481512 (+ 2055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:18.481513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:18.481513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:18.481519 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:18.482652 (+ 1133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.483007 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.483008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.483008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.483056 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.483254 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.483254 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.483255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.483346 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:18.483402 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:18.483627 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 01:14:18.483693 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 01:14:18.483997 25680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:18.475000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:38933 (local address 127.17.183.131:60679)
0812 01:14:18.475189 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:18.475243 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:18.476432 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:18.476702 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:18.476706 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:18.476982 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:18.477182 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:18.477186 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.477822 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.477823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:18.479140 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:18.479142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.479474 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.479475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:18.479575 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:18.480084 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:18.480092 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:18.481428 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:18.482721 (+ 1293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:18.482729 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:18.482730 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:18.482945 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:18.483111 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:18.483111 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:18.483111 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:18.483204 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:18.483404 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:18.483409 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:18.483517 (+ 108us) client_negotiation.cc:769] Sending connection context
0812 01:14:18.483592 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 01:14:18.483710 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":85,"threads_started":1}
I20260812 01:14:18.484436 25676 heartbeater.cc:347] Connected to a master server at 127.17.183.190:38933
I20260812 01:14:18.484575 25676 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:18.484733 25676 heartbeater.cc:511] Master 127.17.183.190:38933 requested a full tablet report, sending...
I20260812 01:14:18.485106 24802 ts_manager.cc:194] Registered new tserver with Master: c2efa8ca051b4225851e558b06b90c3f (127.17.183.131:38395)
I20260812 01:14:18.485435 24802 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:60679
I20260812 01:14:18.486691 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[24725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[24725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:14:18.511516 25691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:18.503203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39006 (local address 127.17.183.129:36037)
0812 01:14:18.503389 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:18.503394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:18.503405 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:14:18.503433 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:18.503435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:18.503448 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:18.503518 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:18.504144 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.504919 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.505596 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.505916 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.505970 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:18.508320 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:18.508336 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:18.508336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:18.508343 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:18.510064 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.510471 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.510475 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.510476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.510539 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.510750 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.510751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.510751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.510905 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:18.511215 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:18.511276 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 01:14:18.511372 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":103,"threads_started":1}
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[24725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:18.519963 24916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:18.512964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57340 (local address 127.17.183.190:38933)
0812 01:14:18.513010 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:18.513012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:18.513039 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:14:18.513131 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:18.513132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:18.513143 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:18.513211 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:18.513691 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.514169 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.515000 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:18.515192 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:18.515285 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:18.517689 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:18.517690 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:18.517691 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:18.517697 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:18.518831 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.519151 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.519152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.519152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.519209 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:18.519406 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:18.519408 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:18.519408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:18.519550 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:18.519653 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:18.519774 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 01:14:18.519865 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 01:14:18.520177 24802 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57340
I20260812 01:14:18.520550 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 24923
I20260812 01:14:18.551833 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 25194
I20260812 01:14:18.563301 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 25446
I20260812 01:14:18.577911 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 24747
2026-08-12T01:14:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2150 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[25700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[25700](info): set up 2 sockets
Aug 12 01:14:18 dist-test-slave-rwrg krb5kdc[25700](info): commencing operation
krb5kdc: starting...
W20260812 01:14:19.878950 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:19 dist-test-slave-rwrg krb5kdc[25700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:14:19.999709 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:36893
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:36893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:20.081700 25729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:20.081955 25729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:20.081995 25729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:20.083163 25729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:20.083223 25729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:20.083244 25729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:20.083284 25729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:20.083310 25729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:20.084853 25729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:36893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:36893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:20.085122 25729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:20.085347 25729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:20.090193 25741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:20.090224 25729 server_base.cc:1034] running on GCE node
W20260812 01:14:20.090183 25737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:20.090186 25736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:20.090644 25729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:20.090952 25729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:20.092114 25729 hybrid_clock.cc:648] HybridClock initialized: now 1786497260092096 us; error 33 us; skew 500 ppm
Aug 12 01:14:20 dist-test-slave-rwrg krb5kdc[25700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497260, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:20.098549 25729 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:14:20.098909 25729 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:20.098979 25729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:20.099124 25729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:20.100155 25729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "d8bf90ca92c24248a080d17b1f49e9eb"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "04afd7636719af6db7ef3980ecd09fd8"
server_key_iv: "4add0ff5dc272c5ae286d6970849ec9e"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.100543 25729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "d8bf90ca92c24248a080d17b1f49e9eb"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "04afd7636719af6db7ef3980ecd09fd8"
server_key_iv: "4add0ff5dc272c5ae286d6970849ec9e"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.101788 25729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:20.102500 25748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:20.102666 25729 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:20.102763 25729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "d8bf90ca92c24248a080d17b1f49e9eb"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "04afd7636719af6db7ef3980ecd09fd8"
server_key_iv: "4add0ff5dc272c5ae286d6970849ec9e"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.102836 25729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:20.115238 25729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:20.116977 25729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:20.117123 25729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:20.121003 25729 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:36893
I20260812 01:14:20.121035 25844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:36893 every 8 connection(s)
I20260812 01:14:20.121304 25729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:20.122340 25845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:20.124680 25845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb: Bootstrap starting.
I20260812 01:14:20.124790 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 25729
I20260812 01:14:20.124899 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:20.125065 18142 external_mini_cluster.cc:1428] Setting key 2e85fd494d3385479dc513aac6fab5f2
I20260812 01:14:20.125437 25845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:20.125823 25845 log.cc:824] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:20.126587 25845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb: No bootstrap required, opened a new log
I20260812 01:14:20.128934 25845 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8bf90ca92c24248a080d17b1f49e9eb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36893 } }
I20260812 01:14:20.129066 25845 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:20.129089 25845 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8bf90ca92c24248a080d17b1f49e9eb, State: Initialized, Role: FOLLOWER
I20260812 01:14:20.129220 25845 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8bf90ca92c24248a080d17b1f49e9eb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36893 } }
I20260812 01:14:20.129319 25845 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:20.129370 25845 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:20.129422 25845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:20.130101 25845 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8bf90ca92c24248a080d17b1f49e9eb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36893 } }
I20260812 01:14:20.130215 25845 leader_election.cc:302] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8bf90ca92c24248a080d17b1f49e9eb; no voters:
I20260812 01:14:20.130395 25845 leader_election.cc:288] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:20.130438 25858 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:20.130627 25858 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [term 1 LEADER]: Becoming Leader. State: Replica: d8bf90ca92c24248a080d17b1f49e9eb, State: Running, Role: LEADER
I20260812 01:14:20.130668 25845 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:20.130740 25858 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8bf90ca92c24248a080d17b1f49e9eb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36893 } }
I20260812 01:14:20.131119 25858 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8bf90ca92c24248a080d17b1f49e9eb. Latest consensus state: current_term: 1 leader_uuid: "d8bf90ca92c24248a080d17b1f49e9eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8bf90ca92c24248a080d17b1f49e9eb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36893 } } }
I20260812 01:14:20.131249 25858 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:20.131213 25862 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8bf90ca92c24248a080d17b1f49e9eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8bf90ca92c24248a080d17b1f49e9eb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36893 } } }
I20260812 01:14:20.131299 25862 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb [sys.catalog]: This master's current role is: LEADER
W20260812 01:14:20.132477 25884 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:14:20.132571 25884 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:14:20.132629 25872 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:20.132791 25872 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 01:14:20 dist-test-slave-rwrg krb5kdc[25700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:20.136734 25856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.125560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37988 (local address 127.17.183.190:36893)
0812 01:14:20.125783 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:20.125792 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:20.125824 (+ 32us) server_negotiation.cc:407] Connection header received
0812 01:14:20.126368 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:20.126377 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:20.126438 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:20.126575 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:20.127217 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.128680 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.129578 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.130214 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.130326 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.133446 (+ 3120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:20.133450 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:20.133451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:20.133462 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:20.135195 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:20.135597 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:20.135599 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:20.135600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:20.135681 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:20.135886 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:20.135887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:20.135887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:20.136090 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:20.136194 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:20.136347 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 01:14:20.136442 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":88,"threads_started":1}
I20260812 01:14:20.140920 25872 catalog_manager.cc:1347] Generated new cluster ID: 13af2d9d55d447ba98113f92588ab7cd
I20260812 01:14:20.140985 25872 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:20.162220 25872 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:20.162953 25872 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:20.176174 25872 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb: Generated new TSK 0
I20260812 01:14:20.176362 25872 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:14:20.211311 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36893
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:20.294116 25894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:20.294344 25894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:20.294384 25894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:20.295552 25894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:20.295617 25894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:20.295662 25894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:20.297191 25894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:20.297446 25894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:20.297669 25894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:20.302692 25902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:20.302709 25894 server_base.cc:1034] running on GCE node
W20260812 01:14:20.302719 25906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:20.302692 25909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:20.303123 25894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:20.303318 25894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:20.304478 25894 hybrid_clock.cc:648] HybridClock initialized: now 1786497260304469 us; error 38 us; skew 500 ppm
Aug 12 01:14:20 dist-test-slave-rwrg krb5kdc[25700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497260, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:20.306851 25894 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:14:20.307175 25894 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:20.307240 25894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:20.307381 25894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:20.308388 25894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "3a75fe76e4524e63a7146f2b3b208a5d"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "9ca56cd0dc3a0cc66eb6010735d255f4"
server_key_iv: "00d9629b5b0c6f39589c132ee27d2375"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.308794 25894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "3a75fe76e4524e63a7146f2b3b208a5d"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "9ca56cd0dc3a0cc66eb6010735d255f4"
server_key_iv: "00d9629b5b0c6f39589c132ee27d2375"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.310186 25894 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:20.310851 25920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:20.311025 25894 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:20.311131 25894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "3a75fe76e4524e63a7146f2b3b208a5d"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "9ca56cd0dc3a0cc66eb6010735d255f4"
server_key_iv: "00d9629b5b0c6f39589c132ee27d2375"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.311198 25894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:20.339893 25894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:20.341805 25894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:20.341971 25894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:20.342216 25894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:20.342530 25894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:20.342581 25894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:20.342613 25894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:20.342635 25894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:20.348798 25894 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:42603
I20260812 01:14:20.348842 26119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:42603 every 8 connection(s)
I20260812 01:14:20.349113 25894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
Aug 12 01:14:20 dist-test-slave-rwrg krb5kdc[25700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497260, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:20.357021 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 25894
I20260812 01:14:20.357141 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:20.357393 18142 external_mini_cluster.cc:1428] Setting key b68f46faf61026ec449c2b2d1ff87fde
I20260812 01:14:20.358419 25856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.349751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:59239 (local address 127.17.183.190:36893)
0812 01:14:20.349819 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:20.349821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:20.350042 (+ 221us) server_negotiation.cc:407] Connection header received
0812 01:14:20.350516 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:20.350517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:20.350527 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:20.350580 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:20.351453 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.351941 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.352975 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.353165 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.353236 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.355275 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:20.355276 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:20.355276 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:20.355283 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:20.356773 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:20.357278 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:20.357279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:20.357279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:20.357335 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:20.357649 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:20.357650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:20.357650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:20.357795 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:20.357863 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:20.358281 (+ 418us) server_negotiation.cc:299] Negotiation successful
0812 01:14:20.358358 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 01:14:20.358577 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.349735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36893 (local address 127.17.183.129:59239)
0812 01:14:20.349908 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:20.349951 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:20.350433 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:20.350649 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:20.350652 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:20.350893 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:20.351378 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.351382 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.352021 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.352022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.352903 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.352906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.353253 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.353254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.353349 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.353828 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:20.353836 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:20.355192 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:20.356860 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:20.356868 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:20.356871 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:20.357200 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:20.357402 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:20.357403 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:20.357404 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:20.357555 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:20.357867 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:20.357874 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:20.358020 (+ 146us) client_negotiation.cc:769] Sending connection context
0812 01:14:20.358129 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 01:14:20.358277 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260812 01:14:20.359144 26120 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36893
I20260812 01:14:20.359237 26120 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:20.359385 26120 heartbeater.cc:511] Master 127.17.183.190:36893 requested a full tablet report, sending...
I20260812 01:14:20.359891 25781 ts_manager.cc:194] Registered new tserver with Master: 3a75fe76e4524e63a7146f2b3b208a5d (127.17.183.129:42603)
I20260812 01:14:20.360466 25781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:59239
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:14:20.383486 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36893
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:20.467607 26129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:20.467792 26129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:20.467813 26129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:20.469002 26129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:20.469044 26129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:20.469094 26129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:20.470650 26129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:20.470908 26129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:20.471158 26129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:20.475957 26142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:20.475962 26144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:20.475973 26147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:20.476199 26129 server_base.cc:1034] running on GCE node
I20260812 01:14:20.476454 26129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:20.476696 26129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:20.477857 26129 hybrid_clock.cc:648] HybridClock initialized: now 1786497260477847 us; error 43 us; skew 500 ppm
Aug 12 01:14:20 dist-test-slave-rwrg krb5kdc[25700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497260, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:20.480427 26129 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:14:20.480772 26129 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:20.480821 26129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:20.480913 26129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:20.481916 26129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "4fa1a976792d4f3397dc5986042d4c95"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "f24aff9ca0e902d4592f95b3113a63d2"
server_key_iv: "a122f17f4cc90159c0251d33ed03f968"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.482218 26129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "4fa1a976792d4f3397dc5986042d4c95"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "f24aff9ca0e902d4592f95b3113a63d2"
server_key_iv: "a122f17f4cc90159c0251d33ed03f968"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.483486 26129 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:20.484231 26158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:20.484397 26129 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:20.484483 26129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "4fa1a976792d4f3397dc5986042d4c95"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "f24aff9ca0e902d4592f95b3113a63d2"
server_key_iv: "a122f17f4cc90159c0251d33ed03f968"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.484593 26129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:20.534710 26129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:20.536938 26129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:20.537074 26129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:20.537305 26129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:20.537684 26129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:20.537725 26129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:20.537776 26129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:20.537809 26129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:20.544304 26129 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:40727
I20260812 01:14:20.544377 26355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:40727 every 8 connection(s)
I20260812 01:14:20.544720 26129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:20.549525 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 26129
I20260812 01:14:20.549638 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:20.549847 18142 external_mini_cluster.cc:1428] Setting key d860d5b68ac328fe7305bf993b1049f8
Aug 12 01:14:20 dist-test-slave-rwrg krb5kdc[25700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497260, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:20.554597 25856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.545544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:44227 (local address 127.17.183.190:36893)
0812 01:14:20.545634 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:20.545636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:20.545851 (+ 215us) server_negotiation.cc:407] Connection header received
0812 01:14:20.546357 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:20.546358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:20.546368 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:20.546428 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:20.547429 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.547953 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.548973 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.549159 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.549217 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.551557 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:20.551559 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:20.551559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:20.551567 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:20.553045 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:20.553542 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:20.553543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:20.553543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:20.553625 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:20.553896 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:20.553897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:20.553897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:20.554045 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:20.554112 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:20.554365 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 01:14:20.554453 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 01:14:20.554628 26358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.545462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36893 (local address 127.17.183.130:44227)
0812 01:14:20.545710 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:20.545754 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:20.546275 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:20.546480 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:20.546483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:20.546726 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:20.547335 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.547340 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.548056 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.548057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.548892 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.548895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.549238 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.549239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.549349 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.549934 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:20.549945 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:20.551470 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:20.553127 (+ 1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:20.553136 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:20.553138 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:20.553468 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:20.553705 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:20.553706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:20.553706 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:20.553836 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:20.554108 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:20.554112 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:20.554239 (+ 127us) client_negotiation.cc:769] Sending connection context
0812 01:14:20.554321 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 01:14:20.554437 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":150,"threads_started":1}
I20260812 01:14:20.555130 26356 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36893
I20260812 01:14:20.555249 26356 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:20.555405 26356 heartbeater.cc:511] Master 127.17.183.190:36893 requested a full tablet report, sending...
I20260812 01:14:20.555842 25781 ts_manager.cc:194] Registered new tserver with Master: 4fa1a976792d4f3397dc5986042d4c95 (127.17.183.130:40727)
I20260812 01:14:20.556245 25781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:44227
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:14:20.577263 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36893
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:20.658833 26362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:20.659070 26362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:20.659113 26362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:20.660264 26362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:20.660323 26362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:20.660367 26362 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:20.661918 26362 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:20.662243 26362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:20.662462 26362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:20.667793 26372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:20.667896 26373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:20.667793 26375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:20.668179 26362 server_base.cc:1034] running on GCE node
I20260812 01:14:20.668432 26362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:20.668697 26362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:20.669869 26362 hybrid_clock.cc:648] HybridClock initialized: now 1786497260669856 us; error 44 us; skew 500 ppm
Aug 12 01:14:20 dist-test-slave-rwrg krb5kdc[25700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497260, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:20.672618 26362 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:14:20.673010 26362 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:20.673059 26362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:20.673197 26362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:20.674312 26362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "4717b868b82a4e5795bb7b69fc1e0e83"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "3103163724f63548a2d576c22945d373"
server_key_iv: "e3bc7192f966a2599ee6d13716fd9bec"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.674664 26362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "4717b868b82a4e5795bb7b69fc1e0e83"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "3103163724f63548a2d576c22945d373"
server_key_iv: "e3bc7192f966a2599ee6d13716fd9bec"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.675973 26362 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:20.676931 26390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:20.677134 26362 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 01:14:20.677222 26362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "4717b868b82a4e5795bb7b69fc1e0e83"
format_stamp: "Formatted at 2026-08-12 01:14:20 on dist-test-slave-rwrg"
server_key: "3103163724f63548a2d576c22945d373"
server_key_iv: "e3bc7192f966a2599ee6d13716fd9bec"
server_key_version: "encryptionkey@0"
I20260812 01:14:20.677284 26362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:20.689641 26362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:20.691375 26362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:20.691483 26362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:20.691651 26362 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:20.691962 26362 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:20.691999 26362 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:20.692020 26362 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:20.692032 26362 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:20.698230 26362 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:40211
I20260812 01:14:20.698278 26585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:40211 every 8 connection(s)
I20260812 01:14:20.698537 26362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:20.702039 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 26362
I20260812 01:14:20.702147 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:20.702332 18142 external_mini_cluster.cc:1428] Setting key 1b293c1d0edc1f6288ff5ce8036ff959
Aug 12 01:14:20 dist-test-slave-rwrg krb5kdc[25700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497260, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:20.707731 25856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.699200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:35343 (local address 127.17.183.190:36893)
0812 01:14:20.699263 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:20.699265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:20.699468 (+ 203us) server_negotiation.cc:407] Connection header received
0812 01:14:20.699982 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:20.699983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:20.699995 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:20.700053 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:20.700989 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.701490 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.702821 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.703024 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.703110 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.705168 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:20.705169 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:20.705170 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:20.705177 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:20.706406 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:20.706814 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:20.706816 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:20.706816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:20.706875 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:20.707135 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:20.707136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:20.707136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:20.707240 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:20.707311 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:20.707564 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 01:14:20.707640 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 01:14:20.707916 26589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.699171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36893 (local address 127.17.183.131:35343)
0812 01:14:20.699350 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:20.699386 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:20.699881 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:20.700124 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:20.700128 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:20.700387 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:20.700891 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.700896 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.701597 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.701599 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.702726 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.702728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.703123 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.703124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.703244 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.703655 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:20.703663 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:20.705076 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:20.706507 (+ 1431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:20.706514 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:20.706516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:20.706726 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:20.706943 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:20.706944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:20.706945 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:20.707060 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:20.707302 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:20.707310 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:20.707440 (+ 130us) client_negotiation.cc:769] Sending connection context
0812 01:14:20.707541 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 01:14:20.707699 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":103,"threads_started":1}
I20260812 01:14:20.708345 26586 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36893
I20260812 01:14:20.708446 26586 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:20.708614 26586 heartbeater.cc:511] Master 127.17.183.190:36893 requested a full tablet report, sending...
I20260812 01:14:20.709005 25781 ts_manager.cc:194] Registered new tserver with Master: 4717b868b82a4e5795bb7b69fc1e0e83 (127.17.183.131:40211)
I20260812 01:14:20.709383 25781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:35343
I20260812 01:14:20.713987 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:14:20.720932 25856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.715243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38002 (local address 127.17.183.190:36893)
0812 01:14:20.715308 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:20.715310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:20.715417 (+ 107us) server_negotiation.cc:407] Connection header received
0812 01:14:20.715491 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:20.715492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:20.715502 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:20.715557 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:20.716108 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.716625 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.717326 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.717521 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.717593 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.718658 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:20.718659 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:20.718659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:20.718666 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:20.719745 (+ 1079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:20.720073 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:20.720074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:20.720075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:20.720139 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:20.720328 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:20.720329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:20.720329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:20.720466 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:20.720618 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:20.720760 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 01:14:20.720835 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 01:14:20.722328 25781 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38002:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:20.723865 25781 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:20.730352 26611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.726162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:42603 (local address 127.0.0.1:38352)
0812 01:14:20.726368 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:20.726409 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:20.726479 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:20.726717 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:20.726720 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:20.726723 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:20.726790 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.726792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.727945 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.727946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.729195 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.729198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.730027 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.730028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.730132 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.730144 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 01:14:20.730223 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 01:14:20.730279 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":60,"threads_started":1}
I20260812 01:14:20.730365 26612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.726272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38352 (local address 127.17.183.129:42603)
0812 01:14:20.726458 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:20.726463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:20.726474 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:14:20.726608 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:20.726612 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:20.726629 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:20.726700 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:20.726849 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.727846 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.729283 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.729944 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.730029 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.730087 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:20.730240 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 01:14:20.730281 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":77,"threads_started":1}
I20260812 01:14:20.730700 26615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.726361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33242 (local address 127.17.183.130:40727)
0812 01:14:20.726834 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:20.726838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:20.726845 (+ 7us) server_negotiation.cc:407] Connection header received
0812 01:14:20.726876 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:20.726877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:20.726889 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:20.726945 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:20.727096 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.728233 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.729512 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.730209 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.730299 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.730354 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:20.730578 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 01:14:20.730623 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":77,"threads_started":1}
I20260812 01:14:20.730973 26606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.726229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:40727 (local address 127.0.0.1:33242)
0812 01:14:20.726528 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:20.726539 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:20.726591 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:20.726983 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:20.726984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:20.726987 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:20.727020 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.727021 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.728356 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.728358 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.729426 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.729428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.730395 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.730397 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.730473 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.730477 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:20.730849 (+ 372us) client_negotiation.cc:240] Negotiation successful
0812 01:14:20.730902 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":86,"threads_started":1}
I20260812 01:14:20.731242 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.726424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:40211 (local address 127.0.0.1:41448)
0812 01:14:20.726657 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:20.726668 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:20.726719 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:20.727307 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:20.727308 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:20.727310 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:20.727353 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.727356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.728630 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.728631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.729620 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.729623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.730969 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.730970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.731027 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.731032 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:14:20.731094 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 01:14:20.731151 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":62,"threads_started":1}
I20260812 01:14:20.731292 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.726610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41448 (local address 127.17.183.131:40211)
0812 01:14:20.727129 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:20.727133 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:20.727143 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:20.727179 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:20.727181 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:20.727195 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:20.727432 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:20.727507 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.728460 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.729706 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.730824 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.730951 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.731010 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:20.731140 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 01:14:20.731204 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":89,"threads_started":1}
I20260812 01:14:20.731241 26002 tablet_service.cc:1467] Processing CreateTablet for tablet e1dd38c1cfed4c358545b8e9a47d0203 (DEFAULT_TABLE table=test-table [id=6cdb0cd234384b0a83597c536e1fd0fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:20.731693 26002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1dd38c1cfed4c358545b8e9a47d0203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:20.731856 26233 tablet_service.cc:1467] Processing CreateTablet for tablet e1dd38c1cfed4c358545b8e9a47d0203 (DEFAULT_TABLE table=test-table [id=6cdb0cd234384b0a83597c536e1fd0fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:20.732290 26233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1dd38c1cfed4c358545b8e9a47d0203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:20.734627 26621 tablet_bootstrap.cc:492] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d: Bootstrap starting.
I20260812 01:14:20.735041 26623 tablet_bootstrap.cc:492] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: Bootstrap starting.
I20260812 01:14:20.735354 26621 tablet_bootstrap.cc:654] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:20.735821 26623 tablet_bootstrap.cc:654] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:20.735733 26480 tablet_service.cc:1467] Processing CreateTablet for tablet e1dd38c1cfed4c358545b8e9a47d0203 (DEFAULT_TABLE table=test-table [id=6cdb0cd234384b0a83597c536e1fd0fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:20.735997 26621 log.cc:824] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:20.736048 26480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1dd38c1cfed4c358545b8e9a47d0203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:20.736402 26623 log.cc:824] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:20.736876 26621 tablet_bootstrap.cc:492] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d: No bootstrap required, opened a new log
I20260812 01:14:20.736970 26621 ts_tablet_manager.cc:1397] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:20.737238 26623 tablet_bootstrap.cc:492] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: No bootstrap required, opened a new log
I20260812 01:14:20.737313 26623 ts_tablet_manager.cc:1397] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:20.738493 26621 raft_consensus.cc:348] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42603 } } peers { permanent_uuid: "4fa1a976792d4f3397dc5986042d4c95" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40727 } } peers { permanent_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 40211 } }
I20260812 01:14:20.738653 26621 raft_consensus.cc:374] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:20.738700 26621 raft_consensus.cc:729] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a75fe76e4524e63a7146f2b3b208a5d, State: Initialized, Role: FOLLOWER
I20260812 01:14:20.738843 26621 consensus_queue.cc:260] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42603 } } peers { permanent_uuid: "4fa1a976792d4f3397dc5986042d4c95" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40727 } } peers { permanent_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 40211 } }
I20260812 01:14:20.739161 26621 ts_tablet_manager.cc:1428] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:20.739300 26120 heartbeater.cc:503] Master 127.17.183.190:36893 was elected leader, sending a full tablet report...
I20260812 01:14:20.739445 26623 raft_consensus.cc:348] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42603 } } peers { permanent_uuid: "4fa1a976792d4f3397dc5986042d4c95" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40727 } } peers { permanent_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 40211 } }
I20260812 01:14:20.739632 26623 raft_consensus.cc:374] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:20.739684 26623 raft_consensus.cc:729] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fa1a976792d4f3397dc5986042d4c95, State: Initialized, Role: FOLLOWER
I20260812 01:14:20.739773 26627 tablet_bootstrap.cc:492] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83: Bootstrap starting.
I20260812 01:14:20.739802 26623 consensus_queue.cc:260] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42603 } } peers { permanent_uuid: "4fa1a976792d4f3397dc5986042d4c95" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40727 } } peers { permanent_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 40211 } }
I20260812 01:14:20.740067 26623 ts_tablet_manager.cc:1428] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:14:20.740089 26356 heartbeater.cc:503] Master 127.17.183.190:36893 was elected leader, sending a full tablet report...
I20260812 01:14:20.740456 26627 tablet_bootstrap.cc:654] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:20.741132 26627 log.cc:824] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:20.741789 26627 tablet_bootstrap.cc:492] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83: No bootstrap required, opened a new log
I20260812 01:14:20.741871 26627 ts_tablet_manager.cc:1397] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:20.743309 26627 raft_consensus.cc:348] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42603 } } peers { permanent_uuid: "4fa1a976792d4f3397dc5986042d4c95" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40727 } } peers { permanent_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 40211 } }
I20260812 01:14:20.743470 26627 raft_consensus.cc:374] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:20.743516 26627 raft_consensus.cc:729] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4717b868b82a4e5795bb7b69fc1e0e83, State: Initialized, Role: FOLLOWER
I20260812 01:14:20.743626 26627 consensus_queue.cc:260] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42603 } } peers { permanent_uuid: "4fa1a976792d4f3397dc5986042d4c95" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40727 } } peers { permanent_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 40211 } }
I20260812 01:14:20.743908 26627 ts_tablet_manager.cc:1428] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:20.743943 26586 heartbeater.cc:503] Master 127.17.183.190:36893 was elected leader, sending a full tablet report...
W20260812 01:14:20.795398 26357 tablet.cc:2369] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:14:20.800149 26634 raft_consensus.cc:482] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:20.800256 26634 raft_consensus.cc:504] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42603 } } peers { permanent_uuid: "4fa1a976792d4f3397dc5986042d4c95" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40727 } } peers { permanent_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 40211 } }
I20260812 01:14:20.800598 26634 leader_election.cc:288] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a75fe76e4524e63a7146f2b3b208a5d (127.17.183.129:42603), 4fa1a976792d4f3397dc5986042d4c95 (127.17.183.130:40727)
I20260812 01:14:20.804288 26612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.800807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:34025 (local address 127.17.183.129:42603)
0812 01:14:20.800858 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:20.800860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:20.800872 (+ 12us) server_negotiation.cc:407] Connection header received
0812 01:14:20.800909 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:20.800910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:20.800920 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:20.801021 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:20.801216 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.801975 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.803337 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.803913 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.803994 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.804002 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:20.804175 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 01:14:20.804213 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 01:14:20.804281 26615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.800963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:59425 (local address 127.17.183.130:40727)
0812 01:14:20.801037 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:20.801039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:20.801050 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:14:20.801133 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:20.801134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:20.801140 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:20.801235 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:20.801358 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.802026 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.803337 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.803915 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.803994 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.804002 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:20.804175 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 01:14:20.804212 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 01:14:20.804324 26589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.800741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:42603 (local address 127.17.183.131:34025)
0812 01:14:20.800796 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:20.800809 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:20.800858 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:20.801039 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:20.801040 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:20.801042 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:20.801124 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.801126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.802051 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.802052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.803247 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.803250 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.804007 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.804008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.804095 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.804099 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:20.804157 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 01:14:20.804213 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":14}
I20260812 01:14:20.804334 26635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.800749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:40727 (local address 127.17.183.131:59425)
0812 01:14:20.801013 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:20.801022 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:20.801060 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:20.801238 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:20.801239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:20.801240 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:20.801296 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.801297 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.802103 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.802104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.803247 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:20.803250 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.804007 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.804008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:20.804099 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.804101 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:14:20.804157 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 01:14:20.804212 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":22,"thread_start_us":126,"threads_started":1}
I20260812 01:14:20.804778 26035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1dd38c1cfed4c358545b8e9a47d0203" candidate_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" is_pre_election: true
I20260812 01:14:20.804772 26278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1dd38c1cfed4c358545b8e9a47d0203" candidate_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fa1a976792d4f3397dc5986042d4c95" is_pre_election: true
I20260812 01:14:20.804939 26278 raft_consensus.cc:2454] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4717b868b82a4e5795bb7b69fc1e0e83 in term 0.
I20260812 01:14:20.804939 26035 raft_consensus.cc:2454] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4717b868b82a4e5795bb7b69fc1e0e83 in term 0.
I20260812 01:14:20.805207 26395 leader_election.cc:302] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4717b868b82a4e5795bb7b69fc1e0e83, 4fa1a976792d4f3397dc5986042d4c95; no voters:
I20260812 01:14:20.805336 26634 raft_consensus.cc:2781] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:20.805411 26634 raft_consensus.cc:482] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:20.805429 26634 raft_consensus.cc:3037] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:20.806344 26634 raft_consensus.cc:504] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42603 } } peers { permanent_uuid: "4fa1a976792d4f3397dc5986042d4c95" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40727 } } peers { permanent_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 40211 } }
I20260812 01:14:20.806484 26634 leader_election.cc:288] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [CANDIDATE]: Term 1 election: Requested vote from peers 3a75fe76e4524e63a7146f2b3b208a5d (127.17.183.129:42603), 4fa1a976792d4f3397dc5986042d4c95 (127.17.183.130:40727)
I20260812 01:14:20.806628 26035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1dd38c1cfed4c358545b8e9a47d0203" candidate_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a75fe76e4524e63a7146f2b3b208a5d"
I20260812 01:14:20.806685 26035 raft_consensus.cc:3037] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:20.806668 26278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1dd38c1cfed4c358545b8e9a47d0203" candidate_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fa1a976792d4f3397dc5986042d4c95"
I20260812 01:14:20.806743 26278 raft_consensus.cc:3037] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:20.807349 26035 raft_consensus.cc:2454] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4717b868b82a4e5795bb7b69fc1e0e83 in term 1.
I20260812 01:14:20.807452 26278 raft_consensus.cc:2454] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4717b868b82a4e5795bb7b69fc1e0e83 in term 1.
I20260812 01:14:20.807554 26396 leader_election.cc:302] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a75fe76e4524e63a7146f2b3b208a5d, 4717b868b82a4e5795bb7b69fc1e0e83; no voters:
I20260812 01:14:20.807649 26634 raft_consensus.cc:2781] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:20.807832 26634 raft_consensus.cc:686] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 1 LEADER]: Becoming Leader. State: Replica: 4717b868b82a4e5795bb7b69fc1e0e83, State: Running, Role: LEADER
I20260812 01:14:20.807945 26634 consensus_queue.cc:237] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42603 } } peers { permanent_uuid: "4fa1a976792d4f3397dc5986042d4c95" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40727 } } peers { permanent_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 40211 } }
I20260812 01:14:20.808764 25781 catalog_manager.cc:5495] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4717b868b82a4e5795bb7b69fc1e0e83 (127.17.183.131). New cstate: current_term: 1 leader_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fa1a976792d4f3397dc5986042d4c95" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4717b868b82a4e5795bb7b69fc1e0e83" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 40211 } health_report { overall_health: HEALTHY } } }
I20260812 01:14:20.822162 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.819993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41456 (local address 127.17.183.131:40211)
0812 01:14:20.820051 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:20.820053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:20.820062 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:20.820104 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:20.820105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:20.820119 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:20.820176 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:20.820295 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.820817 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.821528 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:20.821699 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:20.821747 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:20.821885 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:20.821986 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:20.822043 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:20.822080 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 01:14:20.822096 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 01:14:20.823873 26035 raft_consensus.cc:1261] T e1dd38c1cfed4c358545b8e9a47d0203 P 3a75fe76e4524e63a7146f2b3b208a5d [term 1 FOLLOWER]: Refusing update from remote peer 4717b868b82a4e5795bb7b69fc1e0e83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:20.823872 26278 raft_consensus.cc:1261] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95 [term 1 FOLLOWER]: Refusing update from remote peer 4717b868b82a4e5795bb7b69fc1e0e83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:20.824265 26636 consensus_queue.cc:1035] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a75fe76e4524e63a7146f2b3b208a5d" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:20.824453 26634 consensus_queue.cc:1035] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fa1a976792d4f3397dc5986042d4c95" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 40727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:20.826918 26640 mvcc.cc:205] Tried to move back new op lower bound from 7317492780331876352 to 7317492780270006272. Current Snapshot: MvccSnapshot[applied={T|T < 7317492780331876352}]
I20260812 01:14:20.828060 26642 mvcc.cc:205] Tried to move back new op lower bound from 7317492780331876352 to 7317492780270006272. Current Snapshot: MvccSnapshot[applied={T|T < 7317492780331876352 or (T in {7317492780331876352})}]
I20260812 01:14:20.829097 25778 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:20.829202 25778 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:20.829934 25778 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8bf90ca92c24248a080d17b1f49e9eb: Sending DeleteTablet for 3 replicas of tablet e1dd38c1cfed4c358545b8e9a47d0203
I20260812 01:14:20.830295 26480 tablet_service.cc:1514] Processing DeleteTablet for tablet e1dd38c1cfed4c358545b8e9a47d0203 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:20 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:41448
I20260812 01:14:20.830312 26002 tablet_service.cc:1514] Processing DeleteTablet for tablet e1dd38c1cfed4c358545b8e9a47d0203 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:20 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:38352
I20260812 01:14:20.830578 26233 tablet_service.cc:1514] Processing DeleteTablet for tablet e1dd38c1cfed4c358545b8e9a47d0203 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:20 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:33242
I20260812 01:14:20.830693 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 25894
I20260812 01:14:20.833738 26658 tablet_replica.cc:330] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: stopping tablet replica
I20260812 01:14:20.833860 26658 raft_consensus.cc:2229] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:20.833997 26658 raft_consensus.cc:2258] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:20.836273 26658 ts_tablet_manager.cc:1905] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:20.840070 26658 ts_tablet_manager.cc:1918] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:20.840171 26658 log.cc:1196] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/e1dd38c1cfed4c358545b8e9a47d0203
I20260812 01:14:20.840530 26658 ts_tablet_manager.cc:1939] T e1dd38c1cfed4c358545b8e9a47d0203 P 4fa1a976792d4f3397dc5986042d4c95: Deleting consensus metadata
I20260812 01:14:20.841048 25752 catalog_manager.cc:4841] TS 4fa1a976792d4f3397dc5986042d4c95 (127.17.183.130:40727): tablet e1dd38c1cfed4c358545b8e9a47d0203 (table test-table [id=6cdb0cd234384b0a83597c536e1fd0fb]) successfully deleted
I20260812 01:14:20.852763 26656 tablet_replica.cc:330] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83: stopping tablet replica
I20260812 01:14:20.852938 26656 raft_consensus.cc:2229] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:20.853091 26656 raft_consensus.cc:2258] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:20.855324 26656 ts_tablet_manager.cc:1905] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 01:14:20.862385 25754 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:42603 (error 108)
I20260812 01:14:20.862560 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 26129
I20260812 01:14:20.865258 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.865115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:42603 (local address 127.0.0.1:38360)
0812 01:14:20.865172 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:20.865214 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:42603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 01:14:20.865379 25754 catalog_manager.cc:4584] TS 3a75fe76e4524e63a7146f2b3b208a5d (127.17.183.129:42603): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e1dd38c1cfed4c358545b8e9a47d0203: Network error: Client connection negotiation failed: client connection to 127.17.183.129:42603: connect: Connection refused (error 111)
I20260812 01:14:20.879135 26656 ts_tablet_manager.cc:1918] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:20.879266 26656 log.cc:1196] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/e1dd38c1cfed4c358545b8e9a47d0203
I20260812 01:14:20.879675 26656 ts_tablet_manager.cc:1939] T e1dd38c1cfed4c358545b8e9a47d0203 P 4717b868b82a4e5795bb7b69fc1e0e83: Deleting consensus metadata
I20260812 01:14:20.883780 25752 catalog_manager.cc:4841] TS 4717b868b82a4e5795bb7b69fc1e0e83 (127.17.183.131:40211): tablet e1dd38c1cfed4c358545b8e9a47d0203 (table test-table [id=6cdb0cd234384b0a83597c536e1fd0fb]) successfully deleted
I20260812 01:14:20.887477 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 26362
I20260812 01:14:20.918115 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.917952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:42603 (local address 127.0.0.1:38364)
0812 01:14:20.918020 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:20.918051 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:42603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 01:14:20.918586 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:20.918474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:42603 (local address 127.0.0.1:38376)
0812 01:14:20.918528 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:20.918561 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:42603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 01:14:20.922704 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 25729
2026-08-12T01:14:20Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2349 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T01:14:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:20Z Disabled control of system clock
I20260812 01:14:20.964066 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:42047
--webserver_interface=127.17.183.190
--webserver_port=0
--builtin_ntp_servers=127.17.183.148:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:42047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 01:14:21.054047 26669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:21.054260 26669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:21.054282 26669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:21.055384 26669 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:21.055430 26669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:21.055444 26669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:21.055474 26669 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:21.055487 26669 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:21.056988 26669 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:42047
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:42047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:21.057189 26669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:21.057485 26669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:21.062255 26677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:21.062275 26685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:21.062280 26679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:21.062621 26669 server_base.cc:1034] running on GCE node
I20260812 01:14:21.062897 26669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:21.063140 26669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:21.064278 26669 hybrid_clock.cc:648] HybridClock initialized: now 1786497261064266 us; error 28 us; skew 500 ppm
I20260812 01:14:21.065678 26669 webserver.cc:460] Webserver started at http://127.17.183.190:38575/ using document root <none> and password file <none>
I20260812 01:14:21.065945 26669 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:21.065994 26669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:21.066156 26669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:21.067178 26669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "ccdc48b1d66c49b2823a37497c8b605e"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "93be8b19f57ce139764716e96f2dc6ed"
server_key_iv: "62bfa7ee731a20da62b332b90a0fd3b8"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.067550 26669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "ccdc48b1d66c49b2823a37497c8b605e"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "93be8b19f57ce139764716e96f2dc6ed"
server_key_iv: "62bfa7ee731a20da62b332b90a0fd3b8"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.069103 26669 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:21.069861 26696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:21.070080 26669 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:21.070186 26669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "ccdc48b1d66c49b2823a37497c8b605e"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "93be8b19f57ce139764716e96f2dc6ed"
server_key_iv: "62bfa7ee731a20da62b332b90a0fd3b8"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.070247 26669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:21.073764 26669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:21.073992 26669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:21.074108 26669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:21.078320 26669 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:42047
I20260812 01:14:21.078372 26779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:42047 every 8 connection(s)
I20260812 01:14:21.078694 26669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:21.079344 26780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:21.082350 26780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e: Bootstrap starting.
I20260812 01:14:21.082945 26780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:21.083241 26780 log.cc:824] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:21.083940 26780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e: No bootstrap required, opened a new log
I20260812 01:14:21.085680 26780 raft_consensus.cc:348] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc48b1d66c49b2823a37497c8b605e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 42047 } }
I20260812 01:14:21.085875 26780 raft_consensus.cc:374] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:21.085927 26780 raft_consensus.cc:729] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccdc48b1d66c49b2823a37497c8b605e, State: Initialized, Role: FOLLOWER
I20260812 01:14:21.086069 26780 consensus_queue.cc:260] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc48b1d66c49b2823a37497c8b605e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 42047 } }
I20260812 01:14:21.086148 26780 raft_consensus.cc:388] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:21.086192 26780 raft_consensus.cc:482] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:21.086241 26780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:21.088711 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 26669
I20260812 01:14:21.088819 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:21.088959 18142 external_mini_cluster.cc:1428] Setting key b994a133df56cb135c6d3cc34507ecc7
I20260812 01:14:21.091091 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.089490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33368 (local address 127.17.183.190:42047)
0812 01:14:21.089721 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.089733 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.089768 (+ 35us) server_negotiation.cc:407] Connection header received
0812 01:14:21.089860 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.089866 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.089899 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.090022 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.090657 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.090660 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.090660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.090664 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.090700 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.090711 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.090775 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.090821 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.090890 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
I20260812 01:14:21.106878 26780 raft_consensus.cc:504] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc48b1d66c49b2823a37497c8b605e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 42047 } }
I20260812 01:14:21.107045 26780 leader_election.cc:302] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ccdc48b1d66c49b2823a37497c8b605e; no voters:
I20260812 01:14:21.107261 26780 leader_election.cc:288] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:21.107327 26792 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:21.107486 26792 raft_consensus.cc:686] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [term 1 LEADER]: Becoming Leader. State: Replica: ccdc48b1d66c49b2823a37497c8b605e, State: Running, Role: LEADER
I20260812 01:14:21.107534 26780 sys_catalog.cc:564] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:21.107581 26792 consensus_queue.cc:237] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc48b1d66c49b2823a37497c8b605e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 42047 } }
I20260812 01:14:21.107905 26795 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ccdc48b1d66c49b2823a37497c8b605e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc48b1d66c49b2823a37497c8b605e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 42047 } } }
I20260812 01:14:21.108027 26795 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:21.107904 26796 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccdc48b1d66c49b2823a37497c8b605e. Latest consensus state: current_term: 1 leader_uuid: "ccdc48b1d66c49b2823a37497c8b605e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc48b1d66c49b2823a37497c8b605e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 42047 } } }
I20260812 01:14:21.108191 26796 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:21.108968 26800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:21.109509 26800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:21.110885 26800 catalog_manager.cc:1347] Generated new cluster ID: 08c6ad7119e848b5a1131b47908ad2bc
I20260812 01:14:21.110954 26800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:21.138689 26800 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:21.138904 26800 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:21.154310 26800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e: Generated new TSK 0
I20260812 01:14:21.154524 26800 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:14:21.161373 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:42047
--builtin_ntp_servers=127.17.183.148:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 01:14:21.278205 26819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:21.278409 26819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:21.278430 26819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:21.279547 26819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:21.279585 26819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:21.279610 26819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:21.280969 26819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:42047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:21.281163 26819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:21.281409 26819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:21.286419 26827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:21.286408 26825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:21.286408 26829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:21.286742 26819 server_base.cc:1034] running on GCE node
I20260812 01:14:21.286988 26819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:21.287235 26819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:21.288403 26819 hybrid_clock.cc:648] HybridClock initialized: now 1786497261288393 us; error 34 us; skew 500 ppm
I20260812 01:14:21.289919 26819 webserver.cc:460] Webserver started at http://127.17.183.129:33825/ using document root <none> and password file <none>
I20260812 01:14:21.290164 26819 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:21.290230 26819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:21.290396 26819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:21.291497 26819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "97456e5bc80a42ff80e30bb0c36d9ece"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "35d7a9baadb2096ade014c048092e81d"
server_key_iv: "eb0656c48cac1f2e3f30c705f71bb7a2"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.291877 26819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "97456e5bc80a42ff80e30bb0c36d9ece"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "35d7a9baadb2096ade014c048092e81d"
server_key_iv: "eb0656c48cac1f2e3f30c705f71bb7a2"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.293526 26819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:21.294340 26838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:21.294520 26819 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:21.294623 26819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "97456e5bc80a42ff80e30bb0c36d9ece"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "35d7a9baadb2096ade014c048092e81d"
server_key_iv: "eb0656c48cac1f2e3f30c705f71bb7a2"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.294705 26819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:21.298394 26819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:21.298672 26819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:21.298817 26819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:21.299024 26819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:21.299346 26819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:21.299400 26819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:21.299440 26819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:21.299467 26819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:21.306116 26819 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:34119
I20260812 01:14:21.306166 27022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:34119 every 8 connection(s)
I20260812 01:14:21.306501 26819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:14:21.308022 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 26819
I20260812 01:14:21.308138 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:21.308359 18142 external_mini_cluster.cc:1428] Setting key 1ffd839087982340f42b662eaab8c237
I20260812 01:14:21.309595 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:42047
--builtin_ntp_servers=127.17.183.148:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 01:14:21.310276 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.307265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:57127 (local address 127.17.183.190:42047)
0812 01:14:21.307449 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.307451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.307648 (+ 197us) server_negotiation.cc:407] Connection header received
0812 01:14:21.308427 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.308430 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.308440 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.308539 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.310011 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.310013 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.310013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.310018 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.310036 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.310041 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.310100 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.310176 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.310194 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260812 01:14:21.310484 27026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.307205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:42047 (local address 127.17.183.129:57127)
0812 01:14:21.307470 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:21.307507 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:21.308279 (+ 772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:21.308617 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:21.308621 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:21.308632 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:21.309841 (+ 1209us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:21.309842 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:21.309888 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:21.309932 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:21.310100 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:21.310105 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:21.310108 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:21.310186 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 01:14:21.310247 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":91,"threads_started":1}
I20260812 01:14:21.310983 27023 heartbeater.cc:347] Connected to a master server at 127.17.183.190:42047
I20260812 01:14:21.311121 27023 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:21.311296 27023 heartbeater.cc:511] Master 127.17.183.190:42047 requested a full tablet report, sending...
I20260812 01:14:21.311915 26727 ts_manager.cc:194] Registered new tserver with Master: 97456e5bc80a42ff80e30bb0c36d9ece (127.17.183.129:34119)
W20260812 01:14:21.399317 27031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:21.399513 27031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:21.399535 27031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:21.400718 27031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:21.400761 27031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:21.400787 27031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:21.402860 27031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:42047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:21.403127 27031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:21.403529 27031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:21.410247 27037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:21.412940 27031 server_base.cc:1034] running on GCE node
W20260812 01:14:21.413007 27042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:21.413563 27039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:21.413779 27031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:21.415724 27031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:21.416886 27031 hybrid_clock.cc:648] HybridClock initialized: now 1786497261416864 us; error 38 us; skew 500 ppm
I20260812 01:14:21.418409 27031 webserver.cc:460] Webserver started at http://127.17.183.130:33585/ using document root <none> and password file <none>
I20260812 01:14:21.418737 27031 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:21.418808 27031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:21.418963 27031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:21.420248 27031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "59f680d39ba34d6c9247e33adb4c4560"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "2c52171c3af06e989d407accb6cf268c"
server_key_iv: "f9872363fb4b60b9f22048ea9fa79434"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.420665 27031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "59f680d39ba34d6c9247e33adb4c4560"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "2c52171c3af06e989d407accb6cf268c"
server_key_iv: "f9872363fb4b60b9f22048ea9fa79434"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.422240 27031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:21.423288 27053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:21.423480 27031 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:21.423569 27031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "59f680d39ba34d6c9247e33adb4c4560"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "2c52171c3af06e989d407accb6cf268c"
server_key_iv: "f9872363fb4b60b9f22048ea9fa79434"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.423647 27031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:21.430102 27031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:21.430418 27031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:21.430589 27031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:21.430842 27031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:21.431247 27031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:21.431304 27031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:21.431339 27031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:21.431361 27031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:21.439357 27031 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:43873
I20260812 01:14:21.439469 27253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:43873 every 8 connection(s)
I20260812 01:14:21.439795 27031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:21.443554 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.440635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:58063 (local address 127.17.183.190:42047)
0812 01:14:21.440708 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.440711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.441140 (+ 429us) server_negotiation.cc:407] Connection header received
0812 01:14:21.441913 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.441914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.441933 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.442000 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.443277 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.443278 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.443279 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.443284 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.443303 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.443308 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.443363 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.443447 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.443463 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 01:14:21.443781 27256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.440629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:42047 (local address 127.17.183.130:58063)
0812 01:14:21.440975 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:21.441037 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:21.441784 (+ 747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:21.442126 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:21.442130 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:21.442138 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:21.443105 (+ 967us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:21.443106 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:21.443134 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:21.443162 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:21.443358 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:21.443363 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:21.443367 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:21.443454 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 01:14:21.443535 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":92,"threads_started":1}
I20260812 01:14:21.444288 27254 heartbeater.cc:347] Connected to a master server at 127.17.183.190:42047
I20260812 01:14:21.444414 27254 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:21.444610 27254 heartbeater.cc:511] Master 127.17.183.190:42047 requested a full tablet report, sending...
I20260812 01:14:21.447639 26727 ts_manager.cc:194] Registered new tserver with Master: 59f680d39ba34d6c9247e33adb4c4560 (127.17.183.130:43873)
I20260812 01:14:21.448392 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 27031
I20260812 01:14:21.448555 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:21.448725 18142 external_mini_cluster.cc:1428] Setting key 06783d3610da44b2b76a50e69ce50ca6
I20260812 01:14:21.449805 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:42047
--builtin_ntp_servers=127.17.183.148:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 01:14:21.544138 27257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:21.544399 27257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:21.544441 27257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:21.545702 27257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:21.545764 27257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:21.545807 27257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:21.547142 27257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:42047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:21.547415 27257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:21.547755 27257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:21.552800 27266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:21.552800 27269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:21.552824 27265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:21.553009 27257 server_base.cc:1034] running on GCE node
I20260812 01:14:21.553293 27257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:21.553490 27257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:21.554629 27257 hybrid_clock.cc:648] HybridClock initialized: now 1786497261554629 us; error 39 us; skew 500 ppm
I20260812 01:14:21.555866 27257 webserver.cc:460] Webserver started at http://127.17.183.131:34639/ using document root <none> and password file <none>
I20260812 01:14:21.556113 27257 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:21.556159 27257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:21.556249 27257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:21.557658 27257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "588abc644c634598ad73244837458af7"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "35148058681e6afb6ded8949d29b241e"
server_key_iv: "67c9126ffbead7bfe1a398fee08ec841"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.557964 27257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "588abc644c634598ad73244837458af7"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "35148058681e6afb6ded8949d29b241e"
server_key_iv: "67c9126ffbead7bfe1a398fee08ec841"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.559384 27257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:21.560035 27279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:21.560200 27257 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:21.560286 27257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "588abc644c634598ad73244837458af7"
format_stamp: "Formatted at 2026-08-12 01:14:21 on dist-test-slave-rwrg"
server_key: "35148058681e6afb6ded8949d29b241e"
server_key_iv: "67c9126ffbead7bfe1a398fee08ec841"
server_key_version: "encryptionkey@0"
I20260812 01:14:21.560345 27257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:21.563562 27257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:21.563776 27257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:21.563876 27257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:21.564019 27257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:21.564304 27257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:21.564354 27257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:21.564391 27257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:21.564417 27257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:21.570045 27257 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:33901
I20260812 01:14:21.570114 27475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:33901 every 8 connection(s)
I20260812 01:14:21.570427 27257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:21.573653 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.571180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:45295 (local address 127.17.183.190:42047)
0812 01:14:21.571224 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.571226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.571461 (+ 235us) server_negotiation.cc:407] Connection header received
0812 01:14:21.571994 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.571996 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.572003 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.572066 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.573383 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.573384 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.573384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.573390 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.573407 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.573412 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.573463 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.573564 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.573581 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:14:21.573837 27483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.571145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:42047 (local address 127.17.183.131:45295)
0812 01:14:21.571352 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:21.571383 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:21.571863 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:21.572141 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:21.572149 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:21.572157 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:21.573220 (+ 1063us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:21.573221 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:21.573258 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:21.573284 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:21.573477 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:21.573483 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:21.573486 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:21.573574 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 01:14:21.573641 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":89,"threads_started":1}
I20260812 01:14:21.574298 27481 heartbeater.cc:347] Connected to a master server at 127.17.183.190:42047
I20260812 01:14:21.574402 27481 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:21.574517 27481 heartbeater.cc:511] Master 127.17.183.190:42047 requested a full tablet report, sending...
I20260812 01:14:21.574899 26727 ts_manager.cc:194] Registered new tserver with Master: 588abc644c634598ad73244837458af7 (127.17.183.131:33901)
I20260812 01:14:21.576370 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 27257
I20260812 01:14:21.576471 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:21.576699 18142 external_mini_cluster.cc:1428] Setting key 1f3eaa72423440d147c7a363f8b10e34
I20260812 01:14:21.577629 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:14:21.579770 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.578882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33374 (local address 127.17.183.190:42047)
0812 01:14:21.578929 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.578931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.579041 (+ 110us) server_negotiation.cc:407] Connection header received
0812 01:14:21.579113 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.579113 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.579118 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.579168 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.579615 (+ 447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.579616 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.579617 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.579620 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.579633 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.579637 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.579684 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.579717 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.579728 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 01:14:21.581323 26727 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:21.583087 26727 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:21.587347 27502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.585506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:33901 (local address 127.0.0.1:34006)
0812 01:14:21.585670 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:21.585755 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:21.585811 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:21.586209 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:21.586210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:21.586213 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:21.586912 (+ 699us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:21.586912 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:21.586920 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:21.586935 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:21.587201 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:21.587202 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:21.587203 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 01:14:21.587255 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 01:14:21.587269 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":62,"threads_started":1}
I20260812 01:14:21.587606 27499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.585773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:34119 (local address 127.0.0.1:55954)
0812 01:14:21.585893 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:21.585902 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:21.585935 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:21.586621 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:21.586622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:21.586625 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:21.587107 (+ 482us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:21.587107 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:21.587112 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:21.587122 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:21.587464 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:21.587464 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:21.587465 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 01:14:21.587520 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 01:14:21.587532 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260812 01:14:21.587667 27511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.586173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55954 (local address 127.17.183.129:34119)
0812 01:14:21.586458 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.586462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.586491 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:14:21.586518 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.586520 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.586529 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.586607 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.587306 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.587315 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.587315 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.587319 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.587354 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.587378 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.587466 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.587529 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.587562 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":108,"threads_started":1}
I20260812 01:14:21.587353 27508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.585904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34006 (local address 127.17.183.131:33901)
0812 01:14:21.586054 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.586058 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.586068 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:21.586093 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.586095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.586104 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.586378 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.587055 (+ 677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.587062 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.587062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.587066 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.587095 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.587117 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.587202 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.587262 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.587276 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":80,"threads_started":1}
I20260812 01:14:21.588116 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.585507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:43873 (local address 127.0.0.1:59530)
0812 01:14:21.585880 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:21.585894 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:21.585961 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:21.586129 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:21.586136 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:21.586143 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:21.586809 (+ 666us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:21.586810 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:21.586826 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:21.586848 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:21.587154 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:21.587162 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:21.587165 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:21.587227 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 01:14:21.587252 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":4,"spinlock_wait_cycles":896,"thread_start_us":61,"threads_started":1}
I20260812 01:14:21.588259 27503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.585599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59530 (local address 127.17.183.130:43873)
0812 01:14:21.585797 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.585802 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.585956 (+ 154us) server_negotiation.cc:407] Connection header received
0812 01:14:21.586025 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.586028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.586039 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.586129 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.586946 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.586957 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.586957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.586962 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.587019 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.587065 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.587127 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.587314 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.587331 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
I20260812 01:14:21.588454 27369 tablet_service.cc:1467] Processing CreateTablet for tablet 21b826f39e2344d2be7ec5b0308c228d (DEFAULT_TABLE table=test-table [id=f64e31020a5849ab9233da6c83ff08e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:21.588536 26913 tablet_service.cc:1467] Processing CreateTablet for tablet 21b826f39e2344d2be7ec5b0308c228d (DEFAULT_TABLE table=test-table [id=f64e31020a5849ab9233da6c83ff08e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:21.588824 27369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21b826f39e2344d2be7ec5b0308c228d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:21.588913 26913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21b826f39e2344d2be7ec5b0308c228d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:21.588963 27136 tablet_service.cc:1467] Processing CreateTablet for tablet 21b826f39e2344d2be7ec5b0308c228d (DEFAULT_TABLE table=test-table [id=f64e31020a5849ab9233da6c83ff08e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:21.589277 27136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21b826f39e2344d2be7ec5b0308c228d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:21.591360 27517 tablet_bootstrap.cc:492] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7: Bootstrap starting.
I20260812 01:14:21.591997 27517 tablet_bootstrap.cc:654] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:21.592299 27522 tablet_bootstrap.cc:492] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece: Bootstrap starting.
I20260812 01:14:21.592314 27517 log.cc:824] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:21.592967 27526 tablet_bootstrap.cc:492] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560: Bootstrap starting.
I20260812 01:14:21.593122 27522 tablet_bootstrap.cc:654] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:21.593230 27517 tablet_bootstrap.cc:492] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7: No bootstrap required, opened a new log
I20260812 01:14:21.593326 27517 ts_tablet_manager.cc:1397] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 01:14:21.593473 27522 log.cc:824] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:21.593719 27526 tablet_bootstrap.cc:654] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:21.594058 27526 log.cc:824] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:21.594370 27522 tablet_bootstrap.cc:492] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece: No bootstrap required, opened a new log
I20260812 01:14:21.594487 27522 ts_tablet_manager.cc:1397] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:21.594779 27526 tablet_bootstrap.cc:492] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560: No bootstrap required, opened a new log
I20260812 01:14:21.594844 27526 ts_tablet_manager.cc:1397] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:14:21.596179 27517 raft_consensus.cc:348] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } }
I20260812 01:14:21.596366 27517 raft_consensus.cc:374] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:21.596405 27517 raft_consensus.cc:729] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 588abc644c634598ad73244837458af7, State: Initialized, Role: FOLLOWER
I20260812 01:14:21.596550 27517 consensus_queue.cc:260] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } }
I20260812 01:14:21.596844 27517 ts_tablet_manager.cc:1428] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260812 01:14:21.596887 27481 heartbeater.cc:503] Master 127.17.183.190:42047 was elected leader, sending a full tablet report...
I20260812 01:14:21.596931 27526 raft_consensus.cc:348] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } }
I20260812 01:14:21.597129 27526 raft_consensus.cc:374] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:21.597174 27526 raft_consensus.cc:729] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f680d39ba34d6c9247e33adb4c4560, State: Initialized, Role: FOLLOWER
I20260812 01:14:21.597291 27526 consensus_queue.cc:260] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } }
I20260812 01:14:21.597537 27526 ts_tablet_manager.cc:1428] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:14:21.597656 27254 heartbeater.cc:503] Master 127.17.183.190:42047 was elected leader, sending a full tablet report...
I20260812 01:14:21.597996 27522 raft_consensus.cc:348] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } }
I20260812 01:14:21.598167 27522 raft_consensus.cc:374] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:21.598233 27522 raft_consensus.cc:729] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97456e5bc80a42ff80e30bb0c36d9ece, State: Initialized, Role: FOLLOWER
I20260812 01:14:21.598352 27522 consensus_queue.cc:260] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } }
I20260812 01:14:21.598616 27522 ts_tablet_manager.cc:1428] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260812 01:14:21.598640 27023 heartbeater.cc:503] Master 127.17.183.190:42047 was elected leader, sending a full tablet report...
W20260812 01:14:21.690562 27255 tablet.cc:2369] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:14:21.807183 27024 tablet.cc:2369] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:14:21.821014 27482 tablet.cc:2369] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:14:21.888254 27532 raft_consensus.cc:482] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:21.888432 27532 raft_consensus.cc:504] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } }
I20260812 01:14:21.888901 27532 leader_election.cc:288] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 588abc644c634598ad73244837458af7 (127.17.183.131:33901), 97456e5bc80a42ff80e30bb0c36d9ece (127.17.183.129:34119)
I20260812 01:14:21.890311 27530 raft_consensus.cc:482] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:21.890341 27511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.889203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:34443 (local address 127.17.183.129:34119)
0812 01:14:21.889295 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.889298 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.889310 (+ 12us) server_negotiation.cc:407] Connection header received
0812 01:14:21.889342 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.889343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.889348 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.889411 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.890066 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.890068 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.890068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.890073 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.890093 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.890098 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.890160 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.890241 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.890258 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 01:14:21.890363 27256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.889135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:34119 (local address 127.17.183.130:34443)
0812 01:14:21.889182 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:21.889195 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:21.889269 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:21.889435 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:21.889437 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:21.889440 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:21.889962 (+ 522us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:21.889963 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:21.889970 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:21.889982 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:21.890165 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:21.890166 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:21.890166 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 01:14:21.890231 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 01:14:21.890257 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 01:14:21.890427 27530 raft_consensus.cc:504] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } }
I20260812 01:14:21.890787 27508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.889204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:39907 (local address 127.17.183.131:33901)
0812 01:14:21.889277 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.889283 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.889593 (+ 310us) server_negotiation.cc:407] Connection header received
0812 01:14:21.889679 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.889680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.889685 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.889748 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.890347 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.890348 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.890348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.890353 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.890371 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.890376 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.890421 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.890692 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.890707 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 01:14:21.890810 27530 leader_election.cc:288] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f680d39ba34d6c9247e33adb4c4560 (127.17.183.130:43873), 97456e5bc80a42ff80e30bb0c36d9ece (127.17.183.129:34119)
I20260812 01:14:21.890802 26944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b826f39e2344d2be7ec5b0308c228d" candidate_uuid: "59f680d39ba34d6c9247e33adb4c4560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" is_pre_election: true
I20260812 01:14:21.890980 26944 raft_consensus.cc:2454] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59f680d39ba34d6c9247e33adb4c4560 in term 0.
I20260812 01:14:21.891160 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.889135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:33901 (local address 127.17.183.130:39907)
0812 01:14:21.889503 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:21.889512 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:21.889612 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:21.889768 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:21.889769 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:21.889787 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:21.890237 (+ 450us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:21.890238 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:21.890244 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:21.890256 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:21.890625 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:21.890626 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:21.890626 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 01:14:21.891013 (+ 387us) client_negotiation.cc:240] Negotiation successful
0812 01:14:21.891028 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":188,"thread_start_us":96,"threads_started":1}
I20260812 01:14:21.891264 27054 leader_election.cc:302] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f680d39ba34d6c9247e33adb4c4560, 97456e5bc80a42ff80e30bb0c36d9ece; no voters:
I20260812 01:14:21.891408 27532 raft_consensus.cc:2781] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:21.891462 27532 raft_consensus.cc:482] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:21.891487 27532 raft_consensus.cc:3037] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:21.891556 27395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b826f39e2344d2be7ec5b0308c228d" candidate_uuid: "59f680d39ba34d6c9247e33adb4c4560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "588abc644c634598ad73244837458af7" is_pre_election: true
I20260812 01:14:21.891659 27395 raft_consensus.cc:2454] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59f680d39ba34d6c9247e33adb4c4560 in term 0.
I20260812 01:14:21.892323 27483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.891024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:43873 (local address 127.17.183.131:44663)
0812 01:14:21.891172 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:21.891185 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:21.891223 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:21.891569 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:21.891570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:21.891572 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:21.891999 (+ 427us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:21.892000 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:21.892008 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:21.892021 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:21.892201 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:21.892201 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:21.892202 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 01:14:21.892254 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 01:14:21.892267 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127}
I20260812 01:14:21.892355 27503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.891331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:44663 (local address 127.17.183.130:43873)
0812 01:14:21.891370 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.891373 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.891379 (+ 6us) server_negotiation.cc:407] Connection header received
0812 01:14:21.891398 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.891398 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.891415 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.891465 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.892107 (+ 642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.892108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.892109 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.892114 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.892129 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.892133 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.892195 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.892254 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.892268 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 01:14:21.892660 27170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b826f39e2344d2be7ec5b0308c228d" candidate_uuid: "588abc644c634598ad73244837458af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f680d39ba34d6c9247e33adb4c4560" is_pre_election: true
I20260812 01:14:21.892823 27511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.891584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:41473 (local address 127.17.183.129:34119)
0812 01:14:21.891822 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:21.891824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:21.891838 (+ 14us) server_negotiation.cc:407] Connection header received
0812 01:14:21.891859 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:21.891860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:21.891864 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:21.891916 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:21.892619 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:21.892621 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:21.892621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:21.892625 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:21.892639 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:21.892643 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:21.892711 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:21.892762 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 01:14:21.892775 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215}
I20260812 01:14:21.892860 27536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:21.891134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:34119 (local address 127.17.183.131:41473)
0812 01:14:21.891347 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:21.891357 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:21.891401 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:21.892001 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:21.892002 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:21.892005 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:21.892477 (+ 472us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:21.892478 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:21.892486 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:21.892536 (+ 50us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:21.892716 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:21.892717 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:21.892717 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 01:14:21.892769 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 01:14:21.892783 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":114,"threads_started":1}
I20260812 01:14:21.893138 26944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b826f39e2344d2be7ec5b0308c228d" candidate_uuid: "588abc644c634598ad73244837458af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" is_pre_election: true
I20260812 01:14:21.893213 26944 raft_consensus.cc:2454] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 588abc644c634598ad73244837458af7 in term 0.
I20260812 01:14:21.893368 27280 leader_election.cc:302] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588abc644c634598ad73244837458af7, 97456e5bc80a42ff80e30bb0c36d9ece; no voters:
I20260812 01:14:21.893503 27530 raft_consensus.cc:2781] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:21.893590 27530 raft_consensus.cc:482] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:21.893625 27530 raft_consensus.cc:3037] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:21.962361 27532 raft_consensus.cc:504] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } }
I20260812 01:14:21.962352 27530 raft_consensus.cc:504] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } }
I20260812 01:14:21.962569 27530 leader_election.cc:288] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [CANDIDATE]: Term 1 election: Requested vote from peers 59f680d39ba34d6c9247e33adb4c4560 (127.17.183.130:43873), 97456e5bc80a42ff80e30bb0c36d9ece (127.17.183.129:34119)
I20260812 01:14:21.962646 27532 leader_election.cc:288] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [CANDIDATE]: Term 1 election: Requested vote from peers 588abc644c634598ad73244837458af7 (127.17.183.131:33901), 97456e5bc80a42ff80e30bb0c36d9ece (127.17.183.129:34119)
I20260812 01:14:21.962904 27169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b826f39e2344d2be7ec5b0308c228d" candidate_uuid: "588abc644c634598ad73244837458af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f680d39ba34d6c9247e33adb4c4560"
I20260812 01:14:21.962937 27395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b826f39e2344d2be7ec5b0308c228d" candidate_uuid: "59f680d39ba34d6c9247e33adb4c4560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "588abc644c634598ad73244837458af7"
I20260812 01:14:21.962949 26944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b826f39e2344d2be7ec5b0308c228d" candidate_uuid: "588abc644c634598ad73244837458af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97456e5bc80a42ff80e30bb0c36d9ece"
I20260812 01:14:21.962994 26943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b826f39e2344d2be7ec5b0308c228d" candidate_uuid: "59f680d39ba34d6c9247e33adb4c4560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97456e5bc80a42ff80e30bb0c36d9ece"
I20260812 01:14:21.963052 27395 raft_consensus.cc:2379] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59f680d39ba34d6c9247e33adb4c4560 in current term 1: Already voted for candidate 588abc644c634598ad73244837458af7 in this term.
I20260812 01:14:21.963037 26944 raft_consensus.cc:3037] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:21.963328 27056 leader_election.cc:302] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59f680d39ba34d6c9247e33adb4c4560; no voters: 588abc644c634598ad73244837458af7, 97456e5bc80a42ff80e30bb0c36d9ece
I20260812 01:14:21.963335 27170 raft_consensus.cc:2379] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 588abc644c634598ad73244837458af7 in current term 1: Already voted for candidate 59f680d39ba34d6c9247e33adb4c4560 in this term.
I20260812 01:14:21.963538 27532 raft_consensus.cc:2726] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 01:14:21.964090 26944 raft_consensus.cc:2454] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 588abc644c634598ad73244837458af7 in term 1.
I20260812 01:14:21.964277 27280 leader_election.cc:302] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 588abc644c634598ad73244837458af7, 97456e5bc80a42ff80e30bb0c36d9ece; no voters: 59f680d39ba34d6c9247e33adb4c4560
I20260812 01:14:21.964403 27530 raft_consensus.cc:2781] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:21.964610 27530 raft_consensus.cc:686] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 1 LEADER]: Becoming Leader. State: Replica: 588abc644c634598ad73244837458af7, State: Running, Role: LEADER
I20260812 01:14:21.964718 27530 consensus_queue.cc:237] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } }
I20260812 01:14:21.965569 26727 catalog_manager.cc:5495] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 588abc644c634598ad73244837458af7 (127.17.183.131). New cstate: current_term: 1 leader_uuid: "588abc644c634598ad73244837458af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "588abc644c634598ad73244837458af7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 } health_report { overall_health: UNKNOWN } } }
I20260812 01:14:22.032107 27508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:22.031056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34016 (local address 127.17.183.131:33901)
0812 01:14:22.031110 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:22.031113 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:22.031123 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:22.031171 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:22.031172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:22.031190 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:22.031263 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:22.031849 (+ 586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:22.031850 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:22.031851 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:22.031856 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:22.031873 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:22.031877 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:22.031949 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:22.032004 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 01:14:22.032021 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 01:14:22.034060 26944 raft_consensus.cc:1261] T 21b826f39e2344d2be7ec5b0308c228d P 97456e5bc80a42ff80e30bb0c36d9ece [term 1 FOLLOWER]: Refusing update from remote peer 588abc644c634598ad73244837458af7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:22.034065 27170 raft_consensus.cc:1261] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 1 FOLLOWER]: Refusing update from remote peer 588abc644c634598ad73244837458af7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:22.034338 27530 consensus_queue.cc:1035] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97456e5bc80a42ff80e30bb0c36d9ece" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 34119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:22.034503 27538 consensus_queue.cc:1035] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f680d39ba34d6c9247e33adb4c4560" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:22.037451 27547 mvcc.cc:205] Tried to move back new op lower bound from 7317492785288953856 to 7317492785008193536. Current Snapshot: MvccSnapshot[applied={T|T < 7317492785288953856}]
I20260812 01:14:22.039979 26724 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:22.040086 26724 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:22.040964 26724 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ccdc48b1d66c49b2823a37497c8b605e: Sending DeleteTablet for 3 replicas of tablet 21b826f39e2344d2be7ec5b0308c228d
I20260812 01:14:22.041394 27369 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b826f39e2344d2be7ec5b0308c228d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:22 UTC) from {username='slave'} at 127.0.0.1:34006
I20260812 01:14:22.041441 27136 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b826f39e2344d2be7ec5b0308c228d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:22 UTC) from {username='slave'} at 127.0.0.1:59530
I20260812 01:14:22.041570 26913 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b826f39e2344d2be7ec5b0308c228d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:22 UTC) from {username='slave'} at 127.0.0.1:55954
I20260812 01:14:22.041849 27561 tablet_replica.cc:330] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560: stopping tablet replica
I20260812 01:14:22.041965 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 26819
I20260812 01:14:22.041980 27561 raft_consensus.cc:2229] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:22.041980 27558 tablet_replica.cc:330] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7: stopping tablet replica
I20260812 01:14:22.042102 27561 raft_consensus.cc:2258] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:22.049640 27561 ts_tablet_manager.cc:1905] T 21b826f39e2344d2be7ec5b0308c228d P 59f680d39ba34d6c9247e33adb4c4560: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:22.056761 27558 raft_consensus.cc:2229] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:22.056996 27558 raft_consensus.cc:2258] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:22.057727 27558 ts_tablet_manager.cc:1905] T 21b826f39e2344d2be7ec5b0308c228d P 588abc644c634598ad73244837458af7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 01:14:22.065714 26697 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:34119 (error 108)
I20260812 01:14:22.066382 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:22.066232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:34119 (local address 127.0.0.1:55958)
0812 01:14:22.066291 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:22.066343 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:34119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 01:14:22.066460 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 27031
W20260812 01:14:22.077337 26697 catalog_manager.cc:4584] TS 97456e5bc80a42ff80e30bb0c36d9ece (127.17.183.129:34119): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 21b826f39e2344d2be7ec5b0308c228d: Network error: Client connection negotiation failed: client connection to 127.17.183.129:34119: connect: Connection refused (error 111)
I20260812 01:14:22.082978 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:22.082818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:43873 (local address 127.0.0.1:59536)
0812 01:14:22.082880 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:22.082919 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.130:43873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 01:14:22.083022 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 27257
I20260812 01:14:22.095914 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 26669
I20260812 01:14:22.095991 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:22.095834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:33901 (local address 127.0.0.1:34030)
0812 01:14:22.095898 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:22.095943 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.131:33901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
2026-08-12T01:14:22Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1193 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 01:14:22.149267 18142 mini_oidc.cc:152] Starting JWKS server
I20260812 01:14:22.150537 18142 webserver.cc:460] Webserver started at https://127.0.0.1:42707/ using document root <none> and password file <none>
I20260812 01:14:22.150660 18142 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 01:14:22.150868 18142 webserver.cc:460] Webserver started at http://127.0.0.1:40519/ using document root <none> and password file <none>
2026-08-12T01:14:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:22Z Disabled control of system clock
I20260812 01:14:22.160236 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33187
--webserver_interface=127.17.183.190
--webserver_port=0
--builtin_ntp_servers=127.17.183.148:40021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:33187
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42707/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/testchainca.cert with env {}
W20260812 01:14:22.245836 27572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:22.246111 27572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:22.246138 27572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:22.247328 27572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:22.247370 27572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:22.247382 27572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:22.247394 27572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:22.247406 27572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 01:14:22.247452 27572 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 01:14:22.247467 27572 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42707/jwks.json
I20260812 01:14:22.249039 27572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:33187
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42707/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:22.249330 27572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:22.249579 27572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:22.254518 27587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:22.254689 27582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:22.254812 27572 server_base.cc:1034] running on GCE node
W20260812 01:14:22.254534 27580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:22.255988 27572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:22.256275 27572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:22.257436 27572 hybrid_clock.cc:648] HybridClock initialized: now 1786497262257408 us; error 45 us; skew 500 ppm
I20260812 01:14:22.258697 27572 webserver.cc:460] Webserver started at http://127.17.183.190:44889/ using document root <none> and password file <none>
I20260812 01:14:22.258960 27572 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:22.259047 27572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:22.259191 27572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:22.260197 27572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "2ea58e259b9d408a8742401599b9b0f8"
format_stamp: "Formatted at 2026-08-12 01:14:22 on dist-test-slave-rwrg"
server_key: "13a970e8bc34e47e5db22094d04c6359"
server_key_iv: "e72ccc1f34c49b5f2054ab91cdef99b1"
server_key_version: "encryptionkey@0"
I20260812 01:14:22.260598 27572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "2ea58e259b9d408a8742401599b9b0f8"
format_stamp: "Formatted at 2026-08-12 01:14:22 on dist-test-slave-rwrg"
server_key: "13a970e8bc34e47e5db22094d04c6359"
server_key_iv: "e72ccc1f34c49b5f2054ab91cdef99b1"
server_key_version: "encryptionkey@0"
I20260812 01:14:22.261953 27572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:22.262663 27600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:22.262863 27572 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:22.262962 27572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "2ea58e259b9d408a8742401599b9b0f8"
format_stamp: "Formatted at 2026-08-12 01:14:22 on dist-test-slave-rwrg"
server_key: "13a970e8bc34e47e5db22094d04c6359"
server_key_iv: "e72ccc1f34c49b5f2054ab91cdef99b1"
server_key_version: "encryptionkey@0"
I20260812 01:14:22.263044 27572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:22.293435 27572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:22.293783 27572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:22.293892 27572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:22.297966 27572 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:33187
I20260812 01:14:22.298022 27689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:33187 every 8 connection(s)
I20260812 01:14:22.298377 27572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:22.299505 27692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:22.302033 27692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8: Bootstrap starting.
I20260812 01:14:22.302636 27692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:22.303067 27692 log.cc:824] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:22.303794 27692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8: No bootstrap required, opened a new log
I20260812 01:14:22.304975 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 27572
I20260812 01:14:22.305085 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:22.305270 18142 external_mini_cluster.cc:1428] Setting key 39835ac2961ece5477980abefa664973
I20260812 01:14:22.305768 27692 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea58e259b9d408a8742401599b9b0f8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33187 } }
I20260812 01:14:22.305950 27692 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:22.305997 27692 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea58e259b9d408a8742401599b9b0f8, State: Initialized, Role: FOLLOWER
I20260812 01:14:22.306165 27692 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea58e259b9d408a8742401599b9b0f8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33187 } }
I20260812 01:14:22.306257 27692 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:22.306303 27692 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:22.306351 27692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:22.310712 27700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:22.305869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52024 (local address 127.17.183.190:33187)
0812 01:14:22.306154 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:22.306164 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:22.306200 (+ 36us) server_negotiation.cc:407] Connection header received
0812 01:14:22.306338 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:22.306347 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:22.306422 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:22.306587 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:22.306831 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.308142 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.308985 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.309410 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.309508 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:22.310102 (+ 594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:22.310105 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:22.310105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:22.310270 (+ 165us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:22.310301 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:22.310310 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:22.310361 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:22.310451 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 01:14:22.310554 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":108,"threads_started":1}
I20260812 01:14:22.311764 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:14:22.394439 27692 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea58e259b9d408a8742401599b9b0f8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33187 } }
I20260812 01:14:22.394666 27692 leader_election.cc:302] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ea58e259b9d408a8742401599b9b0f8; no voters:
I20260812 01:14:22.394958 27692 leader_election.cc:288] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:22.395071 27702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:22.395273 27702 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [term 1 LEADER]: Becoming Leader. State: Replica: 2ea58e259b9d408a8742401599b9b0f8, State: Running, Role: LEADER
I20260812 01:14:22.395282 27692 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:22.395419 27702 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea58e259b9d408a8742401599b9b0f8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33187 } }
I20260812 01:14:22.397131 27706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ea58e259b9d408a8742401599b9b0f8. Latest consensus state: current_term: 1 leader_uuid: "2ea58e259b9d408a8742401599b9b0f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea58e259b9d408a8742401599b9b0f8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33187 } } }
I20260812 01:14:22.397136 27704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ea58e259b9d408a8742401599b9b0f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea58e259b9d408a8742401599b9b0f8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33187 } } }
I20260812 01:14:22.397253 27706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:22.397265 27704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8 [sys.catalog]: This master's current role is: LEADER
W20260812 01:14:22.397763 27723 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:14:22.397830 27723 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:14:22.398252 27725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:22.398483 27725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:22.400064 27725 catalog_manager.cc:1347] Generated new cluster ID: b1fef065b0494d529d12fa95a53ca640
I20260812 01:14:22.400135 27725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:22.409595 27725 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:22.410108 27725 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:22.415650 27725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ea58e259b9d408a8742401599b9b0f8: Generated new TSK 0
I20260812 01:14:22.415846 27725 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 01:14:22.447306 27745 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 01:14:22.447468 27745 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260812 01:14:22.448145 27744 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:22.431909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33187 (local address 127.0.0.1:52028)
0812 01:14:22.432125 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:22.432135 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:22.432212 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:22.432396 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:22.432397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:22.432399 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 01:14:22.432467 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:22.432469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.433142 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.433143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:22.433730 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:22.433732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.434105 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.434106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:22.434165 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:22.434189 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 01:14:22.447603 (+ 13414us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 01:14:22.447706 (+ 103us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.183.190:33187: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":98,"threads_started":1}
I20260812 01:14:22.448350 27700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:22.431977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52028 (local address 127.17.183.190:33187)
0812 01:14:22.432042 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:22.432044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:22.432189 (+ 145us) server_negotiation.cc:407] Connection header received
0812 01:14:22.432297 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:22.432299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:22.432311 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:22.432386 (+ 75us) server_negotiation.cc:226] Negotiated authn=JWT
0812 01:14:22.432564 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.433059 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.433816 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.434017 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.434087 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:22.434295 (+ 208us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 01:14:22.447421 (+ 13126us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 01:14:22.448277 (+ 856us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52028: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":35}
W20260812 01:14:22.448398 27700 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52028: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.17.183.190:33187: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 01:14:22.448717 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 27572
2026-08-12T01:14:22Z chronyd exiting
I20260812 01:14:22.495198 18142 test_util.cc:175] -----------------------------------------------
I20260812 01:14:22.495297 18142 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786497235894345-18142-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (347 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 01:14:22.496129 18142 mini_oidc.cc:152] Starting JWKS server
I20260812 01:14:22.496886 18142 webserver.cc:460] Webserver started at https://127.0.0.1:46681/ using document root <none> and password file <none>
I20260812 01:14:22.496949 18142 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 01:14:22.497100 18142 webserver.cc:460] Webserver started at http://127.0.0.1:41127/ using document root <none> and password file <none>
2026-08-12T01:14:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:22Z Disabled control of system clock
I20260812 01:14:22.506193 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44151
--webserver_interface=127.17.183.190
--webserver_port=0
--builtin_ntp_servers=127.17.183.148:37755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:44151
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46681/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/testchainca.cert with env {}
W20260812 01:14:22.592983 27752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:22.593201 27752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:22.593225 27752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:22.594442 27752 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:22.594491 27752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:22.594512 27752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:22.594578 27752 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:22.594626 27752 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 01:14:22.594652 27752 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 01:14:22.594683 27752 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46681/jwks.json
I20260812 01:14:22.596252 27752 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:44151
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46681/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:22.596556 27752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:22.596791 27752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:22.601655 27763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:22.601677 27759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:22.601728 27760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:22.602286 27752 server_base.cc:1034] running on GCE node
I20260812 01:14:22.602604 27752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:22.602887 27752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:22.604055 27752 hybrid_clock.cc:648] HybridClock initialized: now 1786497262604042 us; error 40 us; skew 500 ppm
I20260812 01:14:22.605280 27752 webserver.cc:460] Webserver started at http://127.17.183.190:33883/ using document root <none> and password file <none>
I20260812 01:14:22.605520 27752 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:22.605611 27752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:22.605762 27752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:22.606825 27752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "942aa2b0b72b45ad9f2c4de694f8d8c7"
format_stamp: "Formatted at 2026-08-12 01:14:22 on dist-test-slave-rwrg"
server_key: "08bca5d6dda021a04263e1fbbc18d769"
server_key_iv: "475a49ca86ba692a15aee7d72aa8aaac"
server_key_version: "encryptionkey@0"
I20260812 01:14:22.607223 27752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "942aa2b0b72b45ad9f2c4de694f8d8c7"
format_stamp: "Formatted at 2026-08-12 01:14:22 on dist-test-slave-rwrg"
server_key: "08bca5d6dda021a04263e1fbbc18d769"
server_key_iv: "475a49ca86ba692a15aee7d72aa8aaac"
server_key_version: "encryptionkey@0"
I20260812 01:14:22.608640 27752 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:22.609397 27779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:22.609572 27752 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:22.609695 27752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "942aa2b0b72b45ad9f2c4de694f8d8c7"
format_stamp: "Formatted at 2026-08-12 01:14:22 on dist-test-slave-rwrg"
server_key: "08bca5d6dda021a04263e1fbbc18d769"
server_key_iv: "475a49ca86ba692a15aee7d72aa8aaac"
server_key_version: "encryptionkey@0"
I20260812 01:14:22.609776 27752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:22.632905 27752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:22.633241 27752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:22.633397 27752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:22.637480 27752 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:44151
I20260812 01:14:22.637519 27875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:44151 every 8 connection(s)
I20260812 01:14:22.637878 27752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:22.638748 27878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:22.640877 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 27752
I20260812 01:14:22.641003 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:22.641201 18142 external_mini_cluster.cc:1428] Setting key 22968ffcf78a0b8a6849cbd19632fd43
I20260812 01:14:22.641986 27878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7: Bootstrap starting.
I20260812 01:14:22.642750 27878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:22.643102 27878 log.cc:824] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:22.644088 27878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7: No bootstrap required, opened a new log
I20260812 01:14:22.646431 27878 raft_consensus.cc:348] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942aa2b0b72b45ad9f2c4de694f8d8c7" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44151 } }
I20260812 01:14:22.646566 27878 raft_consensus.cc:374] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:22.646589 27878 raft_consensus.cc:729] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 942aa2b0b72b45ad9f2c4de694f8d8c7, State: Initialized, Role: FOLLOWER
I20260812 01:14:22.646747 27878 consensus_queue.cc:260] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942aa2b0b72b45ad9f2c4de694f8d8c7" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44151 } }
I20260812 01:14:22.646847 27878 raft_consensus.cc:388] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:22.646886 27878 raft_consensus.cc:482] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:22.646940 27878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:22.647477 27881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:22.641732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60524 (local address 127.17.183.190:44151)
0812 01:14:22.641956 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:22.641965 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:22.642000 (+ 35us) server_negotiation.cc:407] Connection header received
0812 01:14:22.642614 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:22.642623 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:22.642747 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:22.642921 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:22.643120 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.644391 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.645216 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.645957 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.646114 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:22.646706 (+ 592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:22.646710 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:22.646710 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:22.646908 (+ 198us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:22.646951 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:22.646964 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:22.647025 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:22.647148 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 01:14:22.647231 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
I20260812 01:14:22.648480 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:14:22.679932 27878 raft_consensus.cc:504] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942aa2b0b72b45ad9f2c4de694f8d8c7" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44151 } }
I20260812 01:14:22.680104 27878 leader_election.cc:302] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 942aa2b0b72b45ad9f2c4de694f8d8c7; no voters:
I20260812 01:14:22.680383 27878 leader_election.cc:288] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:22.680606 27884 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:22.680723 27878 sys_catalog.cc:564] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:22.680879 27884 raft_consensus.cc:686] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [term 1 LEADER]: Becoming Leader. State: Replica: 942aa2b0b72b45ad9f2c4de694f8d8c7, State: Running, Role: LEADER
I20260812 01:14:22.681291 27884 consensus_queue.cc:237] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942aa2b0b72b45ad9f2c4de694f8d8c7" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44151 } }
I20260812 01:14:22.681773 27888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 942aa2b0b72b45ad9f2c4de694f8d8c7. Latest consensus state: current_term: 1 leader_uuid: "942aa2b0b72b45ad9f2c4de694f8d8c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942aa2b0b72b45ad9f2c4de694f8d8c7" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44151 } } }
I20260812 01:14:22.681870 27888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:22.681957 27885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "942aa2b0b72b45ad9f2c4de694f8d8c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942aa2b0b72b45ad9f2c4de694f8d8c7" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44151 } } }
I20260812 01:14:22.682030 27885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:22.682143 27910 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:22.682742 27910 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:22.684528 27910 catalog_manager.cc:1347] Generated new cluster ID: ec234b0d71a6417a9277d63db6716a79
I20260812 01:14:22.684576 27910 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:22.701790 27910 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:22.702296 27910 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:22.713670 27910 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 942aa2b0b72b45ad9f2c4de694f8d8c7: Generated new TSK 0
I20260812 01:14:22.713867 27910 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 01:14:22.745169 27939 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 01:14:22.745270 27939 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 01:14:22.745486 27881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:22.724031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60536 (local address 127.17.183.190:44151)
0812 01:14:22.724079 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:22.724081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:22.724152 (+ 71us) server_negotiation.cc:407] Connection header received
0812 01:14:22.724239 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:22.724240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:22.724251 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:22.724309 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0812 01:14:22.724462 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.724989 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.726126 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.726302 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.726358 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:22.726523 (+ 165us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 01:14:22.745253 (+ 18730us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46681/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 01:14:22.745432 (+ 179us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60536: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46681/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 01:14:22.745537 27881 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60536: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46681/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 01:14:22.745615 27937 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:22.723912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44151 (local address 127.0.0.1:60536)
0812 01:14:22.724095 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:22.724107 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:22.724172 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:22.724321 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:22.724322 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:22.724324 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 01:14:22.724389 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:22.724393 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.725104 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.725105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:22.726046 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:22.726049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.726380 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.726381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:22.726438 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:22.726443 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 01:14:22.745413 (+ 18970us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46681/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 01:14:22.745521 (+ 108us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.183.190:44151: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46681/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":113,"threads_started":1}
I20260812 01:14:22.745930 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 27752
2026-08-12T01:14:22Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (296 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 01:14:22.792603 18142 mini_oidc.cc:152] Starting JWKS server
I20260812 01:14:22.793284 18142 webserver.cc:460] Webserver started at https://127.0.0.1:43307/ using document root <none> and password file <none>
I20260812 01:14:22.793349 18142 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 01:14:22.793533 18142 webserver.cc:460] Webserver started at http://127.0.0.1:33245/ using document root <none> and password file <none>
2026-08-12T01:14:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:22Z Disabled control of system clock
I20260812 01:14:22.802325 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:46329
--webserver_interface=127.17.183.190
--webserver_port=0
--builtin_ntp_servers=127.17.183.148:41633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:46329
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43307/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 01:14:22.882833 27951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:22.883040 27951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:22.883072 27951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:22.884140 27951 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:22.884197 27951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:22.884218 27951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:22.884239 27951 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:22.884265 27951 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 01:14:22.884297 27951 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 01:14:22.884325 27951 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43307/jwks.json
I20260812 01:14:22.885730 27951 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:46329
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:46329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43307/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:22.885995 27951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:22.886304 27951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:22.890995 27969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:22.891007 27966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:22.891001 27965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:22.891286 27951 server_base.cc:1034] running on GCE node
I20260812 01:14:22.891559 27951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:22.891850 27951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:22.893008 27951 hybrid_clock.cc:648] HybridClock initialized: now 1786497262893005 us; error 51 us; skew 500 ppm
I20260812 01:14:22.894403 27951 webserver.cc:460] Webserver started at http://127.17.183.190:45147/ using document root <none> and password file <none>
I20260812 01:14:22.894593 27951 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:22.894637 27951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:22.894730 27951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:22.895761 27951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "5e36bcd439394d83bc1d370ac389e9da"
format_stamp: "Formatted at 2026-08-12 01:14:22 on dist-test-slave-rwrg"
server_key: "f8b08b7b48cf1383c34ee0a57c6ae866"
server_key_iv: "dff73a3e8cdfddbf9b269e7ac2f3da96"
server_key_version: "encryptionkey@0"
I20260812 01:14:22.896085 27951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "5e36bcd439394d83bc1d370ac389e9da"
format_stamp: "Formatted at 2026-08-12 01:14:22 on dist-test-slave-rwrg"
server_key: "f8b08b7b48cf1383c34ee0a57c6ae866"
server_key_iv: "dff73a3e8cdfddbf9b269e7ac2f3da96"
server_key_version: "encryptionkey@0"
I20260812 01:14:22.897524 27951 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:22.898250 27977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:22.898417 27951 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:22.898504 27951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "5e36bcd439394d83bc1d370ac389e9da"
format_stamp: "Formatted at 2026-08-12 01:14:22 on dist-test-slave-rwrg"
server_key: "f8b08b7b48cf1383c34ee0a57c6ae866"
server_key_iv: "dff73a3e8cdfddbf9b269e7ac2f3da96"
server_key_version: "encryptionkey@0"
I20260812 01:14:22.898559 27951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:22.907457 27951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:22.907692 27951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:22.907799 27951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:22.911621 27951 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:46329
I20260812 01:14:22.911682 28068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:46329 every 8 connection(s)
I20260812 01:14:22.911998 27951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:22.912724 28069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:22.915370 28069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da: Bootstrap starting.
I20260812 01:14:22.915911 28069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:22.916208 28069 log.cc:824] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:22.916767 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 27951
I20260812 01:14:22.916878 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:22.917045 18142 external_mini_cluster.cc:1428] Setting key d29aa15162e539a9e964ca8f5640c24c
I20260812 01:14:22.917099 28069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da: No bootstrap required, opened a new log
I20260812 01:14:22.918898 28069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e36bcd439394d83bc1d370ac389e9da" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46329 } }
I20260812 01:14:22.919075 28069 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:22.919121 28069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36bcd439394d83bc1d370ac389e9da, State: Initialized, Role: FOLLOWER
I20260812 01:14:22.919255 28069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e36bcd439394d83bc1d370ac389e9da" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46329 } }
I20260812 01:14:22.919339 28069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:22.919384 28069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:22.919432 28069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:22.919958 28069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e36bcd439394d83bc1d370ac389e9da" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46329 } }
I20260812 01:14:22.920077 28069 leader_election.cc:302] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e36bcd439394d83bc1d370ac389e9da; no voters:
I20260812 01:14:22.920265 28069 leader_election.cc:288] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:22.920300 28080 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:22.920440 28080 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [term 1 LEADER]: Becoming Leader. State: Replica: 5e36bcd439394d83bc1d370ac389e9da, State: Running, Role: LEADER
I20260812 01:14:22.920542 28069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:22.920560 28080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e36bcd439394d83bc1d370ac389e9da" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46329 } }
I20260812 01:14:22.920855 28080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e36bcd439394d83bc1d370ac389e9da. Latest consensus state: current_term: 1 leader_uuid: "5e36bcd439394d83bc1d370ac389e9da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e36bcd439394d83bc1d370ac389e9da" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46329 } } }
I20260812 01:14:22.920933 28080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:22.920867 28081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e36bcd439394d83bc1d370ac389e9da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e36bcd439394d83bc1d370ac389e9da" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46329 } } }
I20260812 01:14:22.921106 28081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:22.921180 28085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:22.921653 28085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:22.923899 28079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:22.917561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35700 (local address 127.17.183.190:46329)
0812 01:14:22.917776 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:22.917784 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:22.917817 (+ 33us) server_negotiation.cc:407] Connection header received
0812 01:14:22.918882 (+ 1065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:22.918888 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:22.918976 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:22.919117 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:22.919315 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.920934 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.921988 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.922509 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.922661 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:22.923296 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:22.923300 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:22.923300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:22.923467 (+ 167us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:22.923499 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:22.923510 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:22.923576 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:22.923661 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 01:14:22.923738 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":77,"threads_started":1}
I20260812 01:14:22.924803 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:14:22.929019 28085 catalog_manager.cc:1347] Generated new cluster ID: dfca050c1b0349cc9846eb8c00dd8466
I20260812 01:14:22.929080 28085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:22.936753 28085 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:22.937230 28085 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:22.943655 28085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e36bcd439394d83bc1d370ac389e9da: Generated new TSK 0
I20260812 01:14:22.943817 28085 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:14:22.959968 28079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:22.956333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35714 (local address 127.17.183.190:46329)
0812 01:14:22.956379 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:22.956381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:22.956473 (+ 92us) server_negotiation.cc:407] Connection header received
0812 01:14:22.956580 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:22.956581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:22.956593 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:22.956665 (+ 72us) server_negotiation.cc:226] Negotiated authn=JWT
0812 01:14:22.956795 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.957553 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.958295 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.958590 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.958653 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:22.958814 (+ 161us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 01:14:22.959765 (+ 951us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43307/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 01:14:22.959901 (+ 136us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35714: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43307/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 01:14:22.960032 28079 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35714: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43307/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 01:14:22.961910 28118 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:22.956241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:46329 (local address 127.0.0.1:35714)
0812 01:14:22.956402 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:22.956412 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:22.956470 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:22.956681 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:22.956682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:22.956684 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 01:14:22.956736 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:22.956738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.957622 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.957622 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:22.958221 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:22.958223 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:22.958672 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:22.958673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:22.958712 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:22.958717 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 01:14:22.959867 (+ 1150us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43307/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 01:14:22.961814 (+ 1947us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.183.190:46329: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43307/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":1745,"thread_start_us":104,"threads_started":1}
I20260812 01:14:22.962257 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 27951
E20260812 01:14:22.975620 28122 webserver.cc:533] Webserver: sslize failed:
E20260812 01:14:22.975700 28122 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T01:14:22Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (212 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T01:14:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:23Z Disabled control of system clock
I20260812 01:14:23.013576 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43615
--webserver_interface=127.17.183.190
--webserver_port=0
--builtin_ntp_servers=127.17.183.148:46643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:43615
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/testchainca.cert with env {}
W20260812 01:14:23.097304 28129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:23.097498 28129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:23.097528 28129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:23.098697 28129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:23.098739 28129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:23.098752 28129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:23.098784 28129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:23.098814 28129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 01:14:23.098830 28129 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 01:14:23.098857 28129 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 01:14:23.100387 28129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:46643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:43615
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:23.100723 28129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:23.100896 28129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:23.105633 28141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:23.105683 28145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:23.105638 28142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:23.105695 28129 server_base.cc:1034] running on GCE node
I20260812 01:14:23.106099 28129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:23.106374 28129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:23.107548 28129 hybrid_clock.cc:648] HybridClock initialized: now 1786497263107531 us; error 33 us; skew 500 ppm
I20260812 01:14:23.108795 28129 webserver.cc:460] Webserver started at http://127.17.183.190:38661/ using document root <none> and password file <none>
I20260812 01:14:23.109038 28129 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:23.109112 28129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:23.109262 28129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:23.110265 28129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "68277a42b84c4217bd3bb72b430b368f"
format_stamp: "Formatted at 2026-08-12 01:14:23 on dist-test-slave-rwrg"
server_key: "48ce25292a977c58414b8298ec6844be"
server_key_iv: "708d4504901b71e3fe06112bb97d1221"
server_key_version: "encryptionkey@0"
I20260812 01:14:23.110630 28129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "68277a42b84c4217bd3bb72b430b368f"
format_stamp: "Formatted at 2026-08-12 01:14:23 on dist-test-slave-rwrg"
server_key: "48ce25292a977c58414b8298ec6844be"
server_key_iv: "708d4504901b71e3fe06112bb97d1221"
server_key_version: "encryptionkey@0"
I20260812 01:14:23.111891 28129 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:23.112680 28160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:23.112860 28129 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:23.112979 28129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "68277a42b84c4217bd3bb72b430b368f"
format_stamp: "Formatted at 2026-08-12 01:14:23 on dist-test-slave-rwrg"
server_key: "48ce25292a977c58414b8298ec6844be"
server_key_iv: "708d4504901b71e3fe06112bb97d1221"
server_key_version: "encryptionkey@0"
I20260812 01:14:23.113050 28129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:23.133142 28129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:23.133430 28129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:23.133585 28129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:23.137508 28129 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:43615
I20260812 01:14:23.137595 28244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:43615 every 8 connection(s)
I20260812 01:14:23.137948 28129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:23.138983 28245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:23.141454 28245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f: Bootstrap starting.
I20260812 01:14:23.142107 28245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:23.142473 28245 log.cc:824] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:23.143190 28245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f: No bootstrap required, opened a new log
I20260812 01:14:23.144939 28245 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68277a42b84c4217bd3bb72b430b368f" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43615 } }
I20260812 01:14:23.145093 28245 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:23.145154 28245 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68277a42b84c4217bd3bb72b430b368f, State: Initialized, Role: FOLLOWER
I20260812 01:14:23.145340 28245 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68277a42b84c4217bd3bb72b430b368f" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43615 } }
I20260812 01:14:23.145432 28245 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:23.145486 28245 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:23.145543 28245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:23.146142 28245 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68277a42b84c4217bd3bb72b430b368f" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43615 } }
I20260812 01:14:23.146260 28245 leader_election.cc:302] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68277a42b84c4217bd3bb72b430b368f; no voters:
I20260812 01:14:23.146458 28245 leader_election.cc:288] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:23.146521 28252 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:23.146709 28252 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [term 1 LEADER]: Becoming Leader. State: Replica: 68277a42b84c4217bd3bb72b430b368f, State: Running, Role: LEADER
I20260812 01:14:23.146721 28245 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:23.146831 28252 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68277a42b84c4217bd3bb72b430b368f" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43615 } }
I20260812 01:14:23.147346 28257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68277a42b84c4217bd3bb72b430b368f. Latest consensus state: current_term: 1 leader_uuid: "68277a42b84c4217bd3bb72b430b368f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68277a42b84c4217bd3bb72b430b368f" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43615 } } }
I20260812 01:14:23.147521 28253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68277a42b84c4217bd3bb72b430b368f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68277a42b84c4217bd3bb72b430b368f" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43615 } } }
I20260812 01:14:23.147616 28257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:23.147637 28253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:23.147969 28277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:23.148022 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 28129
I20260812 01:14:23.148133 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:23.148326 18142 external_mini_cluster.cc:1428] Setting key 62e40f0300bd56726b61a8b2c6426e94
I20260812 01:14:23.148473 28277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:23.150336 28277 catalog_manager.cc:1347] Generated new cluster ID: 2c81875d5d614e62b27ced7d4a498346
I20260812 01:14:23.150399 28277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:23.155077 28289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:23.149109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54020 (local address 127.17.183.190:43615)
0812 01:14:23.149359 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:23.149368 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:23.149447 (+ 79us) server_negotiation.cc:407] Connection header received
0812 01:14:23.149640 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:23.149648 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:23.149736 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:23.149900 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:23.150148 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:23.151598 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:23.152762 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:23.153383 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:23.153498 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:23.154245 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:23.154249 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:23.154249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:23.154465 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:23.154505 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:23.154519 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:23.154588 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:23.154675 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 01:14:23.154873 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":101,"threads_started":1}
I20260812 01:14:23.156020 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:14:23.169090 28277 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:23.169723 28277 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:23.178424 28277 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68277a42b84c4217bd3bb72b430b368f: Generated new TSK 0
I20260812 01:14:23.178629 28277 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:14:23.621071 28289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:23.188866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54034 (local address 127.17.183.190:43615)
0812 01:14:23.188925 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:23.188927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:23.189088 (+ 161us) server_negotiation.cc:407] Connection header received
0812 01:14:23.189164 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:23.189165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:23.189188 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:23.189255 (+ 67us) server_negotiation.cc:226] Negotiated authn=JWT
0812 01:14:23.189399 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:23.189853 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:23.191008 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:23.191186 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:23.191236 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:23.191409 (+ 173us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 01:14:23.620862 (+429453us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 01:14:23.621012 (+ 150us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54034: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":32}
W20260812 01:14:23.621168 28289 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54034: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 01:14:23.621189 28302 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:23.188824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43615 (local address 127.0.0.1:54034)
0812 01:14:23.189016 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:23.189028 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:23.189095 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:23.189271 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:23.189272 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:23.189274 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 01:14:23.189331 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:23.189334 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:23.189956 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:23.189957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:23.190931 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:23.190933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:23.191261 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:23.191262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:23.191320 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:23.191326 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 01:14:23.620989 (+429663us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 01:14:23.621106 (+ 117us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.183.190:43615: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":108,"threads_started":1}
I20260812 01:14:23.621482 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 28129
2026-08-12T01:14:23Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (643 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (93 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (91 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:23 dist-test-slave-rwrg krb5kdc[28320](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:23 dist-test-slave-rwrg krb5kdc[28320](info): set up 2 sockets
Aug 12 01:14:23 dist-test-slave-rwrg krb5kdc[28320](info): commencing operation
krb5kdc: starting...
W20260812 01:14:25.098876 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:14:25.215842 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:46589
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:46589
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:25.296202 28350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:25.296425 28350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:25.296465 28350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:25.297652 28350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:25.297712 28350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:25.297734 28350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:25.297755 28350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:25.297784 28350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:25.299211 28350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:46589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:46589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:25.299476 28350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:25.299696 28350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:25.304298 28363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:25.304304 28356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:25.304304 28355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:25.304319 28350 server_base.cc:1034] running on GCE node
I20260812 01:14:25.304764 28350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:25.304987 28350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:25.306124 28350 hybrid_clock.cc:648] HybridClock initialized: now 1786497265306103 us; error 40 us; skew 500 ppm
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:25.311102 28350 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:14:25.311534 28350 webserver.cc:460] Webserver started at http://127.17.183.190:39471/ using document root <none> and password file <none>
I20260812 01:14:25.311770 28350 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:25.311859 28350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:25.312001 28350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:25.313071 28350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "ac76d5423ef74ae4978199e5123b1099"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "224c28f6c927eba8e15b5f0d5c914f2c"
server_key_iv: "251c1474d9bb7531589bd27f17690492"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.313443 28350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "ac76d5423ef74ae4978199e5123b1099"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "224c28f6c927eba8e15b5f0d5c914f2c"
server_key_iv: "251c1474d9bb7531589bd27f17690492"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.314740 28350 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:14:25.315434 28377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:25.315601 28350 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:25.315701 28350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "ac76d5423ef74ae4978199e5123b1099"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "224c28f6c927eba8e15b5f0d5c914f2c"
server_key_iv: "251c1474d9bb7531589bd27f17690492"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.315770 28350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:25.346773 28350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:25.349356 28350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:25.349520 28350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:25.353566 28350 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:46589
I20260812 01:14:25.353611 28461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:46589 every 8 connection(s)
I20260812 01:14:25.354012 28350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:25.354883 28462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:25.357201 28462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099: Bootstrap starting.
I20260812 01:14:25.357774 28462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:25.358024 28462 log.cc:824] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:25.358644 28462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099: No bootstrap required, opened a new log
I20260812 01:14:25.360208 28462 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac76d5423ef74ae4978199e5123b1099" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46589 } }
I20260812 01:14:25.360371 28462 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:25.360395 28462 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac76d5423ef74ae4978199e5123b1099, State: Initialized, Role: FOLLOWER
I20260812 01:14:25.360523 28462 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac76d5423ef74ae4978199e5123b1099" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46589 } }
I20260812 01:14:25.360641 28462 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:25.360678 28462 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:25.360750 28462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:25.360812 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 28350
I20260812 01:14:25.360926 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:25.361107 18142 external_mini_cluster.cc:1428] Setting key 086602dce30dc182cb71752776bb6506
I20260812 01:14:25.361491 28462 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac76d5423ef74ae4978199e5123b1099" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46589 } }
I20260812 01:14:25.361604 28462 leader_election.cc:302] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac76d5423ef74ae4978199e5123b1099; no voters:
I20260812 01:14:25.361773 28462 leader_election.cc:288] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:25.361995 28470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:25.362061 28462 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:25.362140 28470 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [term 1 LEADER]: Becoming Leader. State: Replica: ac76d5423ef74ae4978199e5123b1099, State: Running, Role: LEADER
I20260812 01:14:25.362232 28470 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac76d5423ef74ae4978199e5123b1099" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46589 } }
I20260812 01:14:25.362591 28470 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac76d5423ef74ae4978199e5123b1099. Latest consensus state: current_term: 1 leader_uuid: "ac76d5423ef74ae4978199e5123b1099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac76d5423ef74ae4978199e5123b1099" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46589 } } }
I20260812 01:14:25.362682 28470 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:25.363004 28472 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac76d5423ef74ae4978199e5123b1099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac76d5423ef74ae4978199e5123b1099" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46589 } } }
I20260812 01:14:25.363112 28472 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:25.363256 28485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:25.363816 28485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:25.366707 28485 catalog_manager.cc:1347] Generated new cluster ID: 67f8faf1ff7b44819d8f38209e825fd6
I20260812 01:14:25.366775 28485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:25.371595 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:25.361608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35952 (local address 127.17.183.190:46589)
0812 01:14:25.361785 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:25.361794 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:25.361826 (+ 32us) server_negotiation.cc:407] Connection header received
0812 01:14:25.361943 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:25.361951 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:25.362000 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:25.362952 (+ 952us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:25.363047 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.364398 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.365422 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.365827 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.365936 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:25.368330 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:25.368334 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:25.368334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:25.368346 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:25.370067 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.370431 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.370434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.370435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.370543 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.370754 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.370755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.370755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.370987 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:25.371149 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:25.371260 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 01:14:25.371398 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":101,"threads_started":1}
I20260812 01:14:25.398597 28485 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:25.399259 28485 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:25.405072 28485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac76d5423ef74ae4978199e5123b1099: Generated new TSK 0
I20260812 01:14:25.405263 28485 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:14:25.443266 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46589
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:25.528420 28500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:25.528666 28500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:25.528692 28500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:25.529815 28500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:25.529858 28500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:25.529886 28500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:25.531314 28500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:25.531515 28500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:25.531705 28500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 01:14:25.536711 28500 server_base.cc:1034] running on GCE node
W20260812 01:14:25.536690 28512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:25.536690 28518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:25.536675 28513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:25.537117 28500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:25.537348 28500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:25.538558 28500 hybrid_clock.cc:648] HybridClock initialized: now 1786497265538540 us; error 41 us; skew 500 ppm
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:25.541182 28500 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:14:25.541683 28500 webserver.cc:460] Webserver started at http://127.17.183.129:43185/ using document root <none> and password file <none>
I20260812 01:14:25.541913 28500 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:25.541980 28500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:25.542129 28500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:25.543138 28500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "f44fb7c25e7041ef9e0fd795f5a67cbd"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "434aa0feaf37229b1d2da599d8699a44"
server_key_iv: "1fbc963921c96b358484192c942e5aad"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.543509 28500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "f44fb7c25e7041ef9e0fd795f5a67cbd"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "434aa0feaf37229b1d2da599d8699a44"
server_key_iv: "1fbc963921c96b358484192c942e5aad"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.544904 28500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:25.545710 28529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:25.545943 28500 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:25.546052 28500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "f44fb7c25e7041ef9e0fd795f5a67cbd"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "434aa0feaf37229b1d2da599d8699a44"
server_key_iv: "1fbc963921c96b358484192c942e5aad"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.546128 28500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:25.575646 28500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:25.577646 28500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:25.577813 28500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:25.578075 28500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:25.578419 28500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:25.578498 28500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:25.578552 28500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:25.578581 28500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:25.585434 28500 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:35593
I20260812 01:14:25.585489 28744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:35593 every 8 connection(s)
I20260812 01:14:25.585846 28500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:14:25.588686 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 28500
I20260812 01:14:25.588801 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:25.588975 18142 external_mini_cluster.cc:1428] Setting key 69608ad4851d08b137078fb3f243b06e
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:25.596287 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:25.586593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:55385 (local address 127.17.183.190:46589)
0812 01:14:25.586679 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:25.586681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:25.586855 (+ 174us) server_negotiation.cc:407] Connection header received
0812 01:14:25.587805 (+ 950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:25.587806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:25.587821 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:25.587877 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:25.588474 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.589219 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.590724 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.590929 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.591021 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:25.593466 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:25.593468 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:25.593468 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:25.593475 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:25.594832 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.595338 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.595339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.595340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.595388 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.595673 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.595674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.595674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.595766 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:25.595815 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:25.596156 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 01:14:25.596224 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 01:14:25.596606 28750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:25.586559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:46589 (local address 127.17.183.129:55385)
0812 01:14:25.586746 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:25.586785 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:25.587697 (+ 912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:25.587945 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:25.587947 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:25.588194 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:25.588391 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:25.588396 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.589342 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.589343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:25.590618 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:25.590623 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.591048 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.591049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:25.591207 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:25.591843 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:25.591852 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:25.593376 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:25.594911 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:25.594919 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:25.594921 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:25.595260 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:25.595453 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:25.595455 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:25.595455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:25.595607 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:25.595830 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:25.595839 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:25.596009 (+ 170us) client_negotiation.cc:769] Sending connection context
0812 01:14:25.596141 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 01:14:25.596336 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260812 01:14:25.597173 28746 heartbeater.cc:347] Connected to a master server at 127.17.183.190:46589
I20260812 01:14:25.597268 28746 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:25.597443 28746 heartbeater.cc:511] Master 127.17.183.190:46589 requested a full tablet report, sending...
I20260812 01:14:25.597993 28412 ts_manager.cc:194] Registered new tserver with Master: f44fb7c25e7041ef9e0fd795f5a67cbd (127.17.183.129:35593)
I20260812 01:14:25.598618 28412 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:55385
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:14:25.615136 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46589
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:25.696846 28758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:25.697068 28758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:25.697103 28758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:25.698230 28758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:25.698288 28758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:25.698333 28758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:25.699821 28758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:25.700086 28758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:25.700307 28758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:25.705209 28765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:25.705219 28763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:25.705224 28767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:25.705426 28758 server_base.cc:1034] running on GCE node
I20260812 01:14:25.705700 28758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:25.705938 28758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:25.707069 28758 hybrid_clock.cc:648] HybridClock initialized: now 1786497265707061 us; error 28 us; skew 500 ppm
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:25.709966 28758 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:14:25.710424 28758 webserver.cc:460] Webserver started at http://127.17.183.130:39203/ using document root <none> and password file <none>
I20260812 01:14:25.710666 28758 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:25.710731 28758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:25.710879 28758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:25.711942 28758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "f706551f009d47d5bde83719c27bf8bb"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "c93a1b45cc8749191c3df1bf0d4394ef"
server_key_iv: "40b250f995d00aded4c8e252445e88be"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.712371 28758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "f706551f009d47d5bde83719c27bf8bb"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "c93a1b45cc8749191c3df1bf0d4394ef"
server_key_iv: "40b250f995d00aded4c8e252445e88be"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.713757 28758 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:25.714455 28782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:25.714640 28758 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:25.714752 28758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "f706551f009d47d5bde83719c27bf8bb"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "c93a1b45cc8749191c3df1bf0d4394ef"
server_key_iv: "40b250f995d00aded4c8e252445e88be"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.714833 28758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:25.727885 28758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:25.729773 28758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:25.729928 28758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:25.730149 28758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:25.730454 28758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:25.730508 28758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:25.730545 28758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:25.730572 28758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:25.736600 28758 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:46423
I20260812 01:14:25.736665 28989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:46423 every 8 connection(s)
I20260812 01:14:25.736979 28758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:25.739734 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 28758
I20260812 01:14:25.739831 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:25.740043 18142 external_mini_cluster.cc:1428] Setting key e310316fe6ad63333617db952769bec5
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:25.746923 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:25.737688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:41885 (local address 127.17.183.190:46589)
0812 01:14:25.737757 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:25.737759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:25.737950 (+ 191us) server_negotiation.cc:407] Connection header received
0812 01:14:25.738896 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:25.738897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:25.738906 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:25.738957 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:25.739567 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.740189 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.741353 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.741704 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.741779 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:25.744132 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:25.744134 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:25.744134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:25.744142 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:25.745554 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.745970 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.745971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.745972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.746031 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.746296 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.746297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.746297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.746419 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:25.746483 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:25.746752 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 01:14:25.746834 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 01:14:25.747155 28995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:25.737673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:46589 (local address 127.17.183.130:41885)
0812 01:14:25.737841 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:25.737877 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:25.738805 (+ 928us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:25.739023 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:25.739027 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:25.739301 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:25.739480 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:25.739485 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.740268 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.740269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:25.741257 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:25.741260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.741805 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.741806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:25.741924 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:25.742440 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:25.742448 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:25.744034 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:25.745655 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:25.745662 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:25.745664 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:25.745882 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:25.746112 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:25.746113 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:25.746114 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:25.746224 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:25.746488 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:25.746495 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:25.746628 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 01:14:25.746730 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 01:14:25.746877 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260812 01:14:25.747633 28991 heartbeater.cc:347] Connected to a master server at 127.17.183.190:46589
I20260812 01:14:25.747737 28991 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:25.747907 28991 heartbeater.cc:511] Master 127.17.183.190:46589 requested a full tablet report, sending...
I20260812 01:14:25.748286 28412 ts_manager.cc:194] Registered new tserver with Master: f706551f009d47d5bde83719c27bf8bb (127.17.183.130:46423)
I20260812 01:14:25.748704 28412 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:41885
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:14:25.767359 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46589
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:25.848809 29001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:25.849005 29001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:25.849027 29001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:25.850252 29001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:25.850296 29001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:25.850350 29001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:25.851847 29001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:46589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:25.852016 29001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:25.852174 29001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:25.857002 29011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:25.857009 29016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:25.857038 29001 server_base.cc:1034] running on GCE node
W20260812 01:14:25.859233 29013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:25.859514 29001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:25.859774 29001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:25.860905 29001 hybrid_clock.cc:648] HybridClock initialized: now 1786497265860886 us; error 37 us; skew 500 ppm
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:25.863808 29001 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:14:25.864295 29001 webserver.cc:460] Webserver started at http://127.17.183.131:44653/ using document root <none> and password file <none>
I20260812 01:14:25.864578 29001 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:25.864642 29001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:25.864780 29001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:25.865803 29001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "de645169fbc44f79a09c2fb6dbb90740"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "644b9e0612a726ad0272864ad7c60493"
server_key_iv: "06f57becdfb48794e3da3de3283e71af"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.866153 29001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "de645169fbc44f79a09c2fb6dbb90740"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "644b9e0612a726ad0272864ad7c60493"
server_key_iv: "06f57becdfb48794e3da3de3283e71af"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.867437 29001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:25.868127 29033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:25.868422 29001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:25.868547 29001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "de645169fbc44f79a09c2fb6dbb90740"
format_stamp: "Formatted at 2026-08-12 01:14:25 on dist-test-slave-rwrg"
server_key: "644b9e0612a726ad0272864ad7c60493"
server_key_iv: "06f57becdfb48794e3da3de3283e71af"
server_key_version: "encryptionkey@0"
I20260812 01:14:25.868623 29001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:25.889559 29001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:25.891839 29001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:25.892015 29001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:25.892252 29001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:25.892575 29001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:25.892627 29001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:25.892668 29001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:25.892694 29001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:25.898599 29001 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:39633
I20260812 01:14:25.898653 29229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:39633 every 8 connection(s)
I20260812 01:14:25.898940 29001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:25.902248 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 29001
I20260812 01:14:25.902351 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:25.902541 18142 external_mini_cluster.cc:1428] Setting key 4e61b42c388d0c872858ac60fdec2eb9
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:25.908231 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:25.899665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:54191 (local address 127.17.183.190:46589)
0812 01:14:25.899732 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:25.899734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:25.899965 (+ 231us) server_negotiation.cc:407] Connection header received
0812 01:14:25.900960 (+ 995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:25.900962 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:25.900972 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:25.901032 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:25.901655 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.902196 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.903626 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.903819 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.903874 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:25.905980 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:25.905982 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:25.905982 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:25.905989 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:25.907154 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.907492 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.907493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.907493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.907541 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.907751 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.907751 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.907751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.907847 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:25.907897 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:25.908107 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 01:14:25.908169 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 01:14:25.908432 29236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:25.899652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:46589 (local address 127.17.183.131:54191)
0812 01:14:25.899835 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:25.899877 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:25.900869 (+ 992us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:25.901118 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:25.901122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:25.901372 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:25.901564 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:25.901567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.902299 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.902300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:25.903547 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:25.903554 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.903894 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.903895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:25.903996 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:25.904412 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:25.904420 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:25.905898 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:25.907221 (+ 1323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:25.907227 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:25.907229 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:25.907431 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:25.907600 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:25.907601 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:25.907601 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:25.907693 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:25.907898 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:25.907902 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:25.908005 (+ 103us) client_negotiation.cc:769] Sending connection context
0812 01:14:25.908082 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 01:14:25.908199 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
I20260812 01:14:25.908939 29233 heartbeater.cc:347] Connected to a master server at 127.17.183.190:46589
I20260812 01:14:25.909040 29233 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:25.909273 29233 heartbeater.cc:511] Master 127.17.183.190:46589 requested a full tablet report, sending...
I20260812 01:14:25.909629 28412 ts_manager.cc:194] Registered new tserver with Master: de645169fbc44f79a09c2fb6dbb90740 (127.17.183.131:39633)
I20260812 01:14:25.909965 28412 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:54191
I20260812 01:14:25.914191 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/test-admin.keytab.
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:25.931191 18142 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 01:14:25.932723 29244 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:25.931966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35856 (local address 127.17.183.129:35593)
0812 01:14:25.932134 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:25.932138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:25.932146 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:25.932172 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:25.932174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:25.932186 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:25.932244 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:25.932638 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35856: BlockingRecv error: recv got EOF from 127.0.0.1:35856 (error 108)
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
W20260812 01:14:25.932878 18142 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/krb5cc' of type FILE
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:25.933903 18142 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:25.934808 18142 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:14:25.941980 29244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:25.935275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35870 (local address 127.17.183.129:35593)
0812 01:14:25.935328 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:25.935330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:25.935338 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:25.935376 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:25.935376 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:25.935385 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:25.935428 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:25.935771 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.936468 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.937187 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.937481 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.937535 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:25.939521 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:25.939529 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:25.939529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:25.939536 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:25.940965 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.941267 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.941270 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.941270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.941320 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.941479 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.941479 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.941480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.941600 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:25.941691 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:25.941776 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 01:14:25.941833 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 01:14:25.943614 29244 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:25.943112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35878 (local address 127.17.183.129:35593)
0812 01:14:25.943146 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:25.943147 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:25.943195 (+ 48us) server_negotiation.cc:407] Connection header received
0812 01:14:25.943250 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:25.943251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:25.943260 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:25.943306 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:25.943549 (+ 243us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35878: BlockingRecv error: recv got EOF from 127.0.0.1:35878 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 01:14:25.943709 18142 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/krb5cc' of type FILE
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:25.944644 18142 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:25.945456 18142 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:14:25.952081 29244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:25.945954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35892 (local address 127.17.183.129:35593)
0812 01:14:25.946003 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:25.946005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:25.946051 (+ 46us) server_negotiation.cc:407] Connection header received
0812 01:14:25.946112 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:25.946113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:25.946123 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:25.946186 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:25.946529 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.946996 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.947649 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.947834 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.947900 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:25.949884 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:25.949885 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:25.949886 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:25.949897 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:25.951007 (+ 1110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.951325 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.951327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.951327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.951379 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.951565 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.951566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.951567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.951657 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:25.951771 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:25.951916 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 01:14:25.951993 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 01:14:25.953522 29244 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:25.953008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35908 (local address 127.17.183.129:35593)
0812 01:14:25.953043 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:25.953045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:25.953092 (+ 47us) server_negotiation.cc:407] Connection header received
0812 01:14:25.953161 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:25.953162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:25.953170 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:25.953223 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:25.953476 (+ 253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35908: BlockingRecv error: recv got EOF from 127.0.0.1:35908 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 01:14:25.953594 18142 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786497235894345-18142-0/krb5kdc/krb5cc' of type FILE
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:25.954469 18142 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:25.955281 18142 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 01:14:25 dist-test-slave-rwrg krb5kdc[28320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:14:25.961531 29244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:25.955759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35918 (local address 127.17.183.129:35593)
0812 01:14:25.955803 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:25.955804 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:25.955813 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:25.955867 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:25.955868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:25.955875 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:25.955914 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:25.956218 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.956709 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.957357 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:25.957519 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:25.957566 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:25.959514 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:25.959515 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:25.959515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:25.959520 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:25.960708 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.960991 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.960992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.960992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.961036 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:25.961167 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:25.961168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:25.961168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:25.961233 (+ 65us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:25.961297 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:25.961430 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 01:14:25.961478 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 01:14:25.962167 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 28500
I20260812 01:14:25.975538 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 28758
I20260812 01:14:25.991534 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 29001
I20260812 01:14:26.002964 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 28350
2026-08-12T01:14:26Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2198 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:26 dist-test-slave-rwrg krb5kdc[29260](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:26 dist-test-slave-rwrg krb5kdc[29260](info): set up 2 sockets
Aug 12 01:14:26 dist-test-slave-rwrg krb5kdc[29260](info): commencing operation
krb5kdc: starting...
W20260812 01:14:27.337407 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:27 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:27Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.190.keytab.
Entry for principal oryx/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.190.keytab.
I20260812 01:14:27.459039 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43571
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.190.keytab
--principal=oryx/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:42991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:43571
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:27.545800 29277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:27.546065 29277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:27.546103 29277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:27.547221 29277 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:27.547292 29277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:27.547314 29277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:27.547334 29277 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:27.547366 29277 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:27.548864 29277 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:42991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:43571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.190.keytab
--principal=oryx/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:27.549145 29277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:27.549386 29277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:27.554114 29289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:27.554195 29277 server_base.cc:1034] running on GCE node
W20260812 01:14:27.554107 29290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:27.554131 29292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:27.554574 29277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:27.554854 29277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:27.556030 29277 hybrid_clock.cc:648] HybridClock initialized: now 1786497267556015 us; error 31 us; skew 500 ppm
Aug 12 01:14:27 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497267, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:27.558596 29277 init.cc:377] Logged in from keytab as oryx/127.17.183.190@KRBTEST.COM (short username oryx)
I20260812 01:14:27.559015 29277 webserver.cc:460] Webserver started at http://127.17.183.190:33965/ using document root <none> and password file <none>
I20260812 01:14:27.559201 29277 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:27.559247 29277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:27.559338 29277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:27.560302 29277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "ecb17584ae4e4e51a5aa7f580ec47253"
format_stamp: "Formatted at 2026-08-12 01:14:27 on dist-test-slave-rwrg"
server_key: "cba257d35ccd444d5ba3e879e9da34b7"
server_key_iv: "f5e5a089c60ef1b2950f03dccca5a26c"
server_key_version: "encryptionkey@0"
I20260812 01:14:27.560700 29277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "ecb17584ae4e4e51a5aa7f580ec47253"
format_stamp: "Formatted at 2026-08-12 01:14:27 on dist-test-slave-rwrg"
server_key: "cba257d35ccd444d5ba3e879e9da34b7"
server_key_iv: "f5e5a089c60ef1b2950f03dccca5a26c"
server_key_version: "encryptionkey@0"
I20260812 01:14:27.561973 29277 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:27.562618 29302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:27.562819 29277 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:27.562902 29277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "ecb17584ae4e4e51a5aa7f580ec47253"
format_stamp: "Formatted at 2026-08-12 01:14:27 on dist-test-slave-rwrg"
server_key: "cba257d35ccd444d5ba3e879e9da34b7"
server_key_iv: "f5e5a089c60ef1b2950f03dccca5a26c"
server_key_version: "encryptionkey@0"
I20260812 01:14:27.562954 29277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:27.589860 29277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:27.591713 29277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:27.591822 29277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:27.595688 29277 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:43571
I20260812 01:14:27.595781 29397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:43571 every 8 connection(s)
I20260812 01:14:27.596099 29277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:27.597172 29398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:27.599447 29398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253: Bootstrap starting.
I20260812 01:14:27.600024 29398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:27.600311 29398 log.cc:824] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:27.601140 29398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253: No bootstrap required, opened a new log
I20260812 01:14:27.602738 29398 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } }
I20260812 01:14:27.602891 29398 raft_consensus.cc:374] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:27.602931 29398 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb17584ae4e4e51a5aa7f580ec47253, State: Initialized, Role: FOLLOWER
I20260812 01:14:27.603087 29398 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } }
I20260812 01:14:27.603168 29398 raft_consensus.cc:388] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:27.603219 29398 raft_consensus.cc:482] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:27.603271 29398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:27.603910 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 29277
I20260812 01:14:27.604036 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:27.604210 29398 raft_consensus.cc:504] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } }
I20260812 01:14:27.604285 18142 external_mini_cluster.cc:1428] Setting key e1887df976e76e677189c253c3f01e9d
I20260812 01:14:27.604321 29398 leader_election.cc:302] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecb17584ae4e4e51a5aa7f580ec47253; no voters:
I20260812 01:14:27.604506 29398 leader_election.cc:288] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:27.604564 29404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:27.604704 29404 raft_consensus.cc:686] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 1 LEADER]: Becoming Leader. State: Replica: ecb17584ae4e4e51a5aa7f580ec47253, State: Running, Role: LEADER
I20260812 01:14:27.604801 29404 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } }
I20260812 01:14:27.605042 29398 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:27.605124 29407 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ecb17584ae4e4e51a5aa7f580ec47253. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } }
I20260812 01:14:27.605161 29406 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } }
I20260812 01:14:27.605224 29407 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:27.605237 29406 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:27.605449 29413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:27.606098 29413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:27.607867 29413 catalog_manager.cc:1347] Generated new cluster ID: b72805d0b192477988222afaeee3b72c
I20260812 01:14:27.607928 29413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:14:27 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:27.616876 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:27.604788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58562 (local address 127.17.183.190:43571)
0812 01:14:27.605000 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:27.605009 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:27.605522 (+ 513us) server_negotiation.cc:407] Connection header received
0812 01:14:27.605728 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:27.605736 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:27.605824 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:27.605937 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:27.606972 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:27.608277 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:27.609356 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:27.609992 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:27.610110 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:27.612970 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:27.612974 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:27.612975 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:27.612988 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:27.615046 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:27.615455 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:27.615459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:27.615459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:27.615610 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:27.615822 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:27.615823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:27.615823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:27.616105 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:27.616256 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:27.616514 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 01:14:27.616664 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":84,"threads_started":1}
I20260812 01:14:27.624773 29413 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:27.625274 29413 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:27.634446 29413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253: Generated new TSK 0
I20260812 01:14:27.634632 29413 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab.
Entry for principal oryx/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab.
I20260812 01:14:27.663388 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43571
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab
--principal=oryx/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:42991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:27.781383 29442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:27.781597 29442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:27.781620 29442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:27.782752 29442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:27.782793 29442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:27.782819 29442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:27.784235 29442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:42991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab
--principal=oryx/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:27.784472 29442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:27.784792 29442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:27.789883 29453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:27.789911 29455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:27.789923 29451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:27.790030 29442 server_base.cc:1034] running on GCE node
I20260812 01:14:27.790320 29442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:27.790572 29442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:27.791719 29442 hybrid_clock.cc:648] HybridClock initialized: now 1786497267791692 us; error 43 us; skew 500 ppm
Aug 12 01:14:27 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497267, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:27.794198 29442 init.cc:377] Logged in from keytab as oryx/127.17.183.129@KRBTEST.COM (short username oryx)
I20260812 01:14:27.794703 29442 webserver.cc:460] Webserver started at http://127.17.183.129:39513/ using document root <none> and password file <none>
I20260812 01:14:27.794927 29442 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:27.794991 29442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:27.795140 29442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:27.796168 29442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "2519cfbc421d4a77aaf37acbface3339"
format_stamp: "Formatted at 2026-08-12 01:14:27 on dist-test-slave-rwrg"
server_key: "3747a6ebe0248546d9f2e01b716deaf8"
server_key_iv: "f868705be6a8d6dc0e130ab0a05db712"
server_key_version: "encryptionkey@0"
I20260812 01:14:27.796617 29442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "2519cfbc421d4a77aaf37acbface3339"
format_stamp: "Formatted at 2026-08-12 01:14:27 on dist-test-slave-rwrg"
server_key: "3747a6ebe0248546d9f2e01b716deaf8"
server_key_iv: "f868705be6a8d6dc0e130ab0a05db712"
server_key_version: "encryptionkey@0"
I20260812 01:14:27.797963 29442 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:27.798707 29474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:27.798887 29442 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:27.798988 29442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "2519cfbc421d4a77aaf37acbface3339"
format_stamp: "Formatted at 2026-08-12 01:14:27 on dist-test-slave-rwrg"
server_key: "3747a6ebe0248546d9f2e01b716deaf8"
server_key_iv: "f868705be6a8d6dc0e130ab0a05db712"
server_key_version: "encryptionkey@0"
I20260812 01:14:27.799072 29442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:27.813164 29442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:27.814931 29442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:27.815105 29442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:27.815330 29442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:27.815639 29442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:27.815688 29442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:27.815727 29442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:27.815752 29442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:27.821848 29442 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:45743
I20260812 01:14:27.821907 29667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:45743 every 8 connection(s)
I20260812 01:14:27.822213 29442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
Aug 12 01:14:27 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497267, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:27.830338 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 29442
I20260812 01:14:27.830451 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:27.830679 18142 external_mini_cluster.cc:1428] Setting key 1d6d8cc1ca0eaf6cf3d8ca315b47c0d2
I20260812 01:14:27.831533 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:27.822936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:45833 (local address 127.17.183.190:43571)
0812 01:14:27.823001 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:27.823003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:27.823229 (+ 226us) server_negotiation.cc:407] Connection header received
0812 01:14:27.823768 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:27.823770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:27.823785 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:27.823840 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:27.824782 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:27.825275 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:27.826236 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:27.826459 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:27.826531 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:27.828747 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:27.828749 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:27.828749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:27.828756 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:27.830014 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:27.830428 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:27.830429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:27.830430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:27.830494 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:27.830803 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:27.830804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:27.830805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:27.830918 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:27.830991 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:27.831328 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 01:14:27.831429 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 01:14:27.831595 29672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:27.822920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.129:45833)
0812 01:14:27.823106 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:27.823142 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:27.823642 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:27.823905 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:27.823908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:27.824470 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:27.824680 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:27.824685 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:27.825400 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:27.825401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:27.826145 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:27.826147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:27.826560 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:27.826561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:27.826672 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:27.827145 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:27.827154 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:27.828649 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:27.830087 (+ 1438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:27.830094 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:27.830096 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:27.830328 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:27.830630 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:27.830630 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:27.830631 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:27.830733 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:27.831057 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:27.831063 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:27.831173 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 01:14:27.831284 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 01:14:27.831420 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":100,"threads_started":1}
I20260812 01:14:27.832126 29669 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43571
I20260812 01:14:27.832244 29669 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:27.832415 29669 heartbeater.cc:511] Master 127.17.183.190:43571 requested a full tablet report, sending...
I20260812 01:14:27.833000 29338 ts_manager.cc:194] Registered new tserver with Master: 2519cfbc421d4a77aaf37acbface3339 (127.17.183.129:45743)
I20260812 01:14:27.833670 29338 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:45833
WARNING: no policy specified for oryx/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab.
Entry for principal oryx/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab.
I20260812 01:14:27.858850 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43571
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab
--principal=oryx/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:42991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:27.943401 29675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:27.943643 29675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:27.943686 29675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:27.944923 29675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:27.944989 29675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:27.945035 29675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:27.946554 29675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:42991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab
--principal=oryx/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:27.946834 29675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:27.947080 29675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:27.952131 29685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:27.952139 29688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:27.952147 29686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:27.952286 29675 server_base.cc:1034] running on GCE node
I20260812 01:14:27.952684 29675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:27.952924 29675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:27.954073 29675 hybrid_clock.cc:648] HybridClock initialized: now 1786497267954058 us; error 41 us; skew 500 ppm
Aug 12 01:14:27 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497267, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:27.956748 29675 init.cc:377] Logged in from keytab as oryx/127.17.183.130@KRBTEST.COM (short username oryx)
I20260812 01:14:27.957185 29675 webserver.cc:460] Webserver started at http://127.17.183.130:44273/ using document root <none> and password file <none>
I20260812 01:14:27.957438 29675 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:27.957484 29675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:27.957646 29675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:27.958667 29675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "0d29775d69234b4fa0c3ca59918ff40e"
format_stamp: "Formatted at 2026-08-12 01:14:27 on dist-test-slave-rwrg"
server_key: "2c869b1ceb5d84e6441c8da330f0b27c"
server_key_iv: "dda2653d7c01a01a3c78464f13bf3595"
server_key_version: "encryptionkey@0"
I20260812 01:14:27.959015 29675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "0d29775d69234b4fa0c3ca59918ff40e"
format_stamp: "Formatted at 2026-08-12 01:14:27 on dist-test-slave-rwrg"
server_key: "2c869b1ceb5d84e6441c8da330f0b27c"
server_key_iv: "dda2653d7c01a01a3c78464f13bf3595"
server_key_version: "encryptionkey@0"
I20260812 01:14:27.960305 29675 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:27.961072 29700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:27.961287 29675 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:27.961381 29675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "0d29775d69234b4fa0c3ca59918ff40e"
format_stamp: "Formatted at 2026-08-12 01:14:27 on dist-test-slave-rwrg"
server_key: "2c869b1ceb5d84e6441c8da330f0b27c"
server_key_iv: "dda2653d7c01a01a3c78464f13bf3595"
server_key_version: "encryptionkey@0"
I20260812 01:14:27.961462 29675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:27.971364 29675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:27.973306 29675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:27.973462 29675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:27.973680 29675 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:27.973984 29675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:27.974035 29675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:27.974087 29675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:27.974119 29675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:27.980006 29675 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:37419
I20260812 01:14:27.980059 29906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:37419 every 8 connection(s)
I20260812 01:14:27.980366 29675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:27.984416 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 29675
I20260812 01:14:27.984550 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:27.984772 18142 external_mini_cluster.cc:1428] Setting key 06acb136c177aecc6e36a7891ada9856
Aug 12 01:14:27 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497267, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:27.991079 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:27.981080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:44061 (local address 127.17.183.190:43571)
0812 01:14:27.981157 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:27.981159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:27.981402 (+ 243us) server_negotiation.cc:407] Connection header received
0812 01:14:27.981964 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:27.981966 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:27.981980 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:27.982039 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:27.982998 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:27.983509 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:27.984750 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:27.985049 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:27.985121 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:27.987934 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:27.987935 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:27.987936 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:27.987944 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:27.989612 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:27.990010 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:27.990011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:27.990012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:27.990078 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:27.990325 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:27.990326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:27.990327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:27.990499 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:27.990583 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:27.990857 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 01:14:27.990970 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 01:14:27.991218 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:27.981075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.130:44061)
0812 01:14:27.981259 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:27.981322 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:27.981845 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:27.982108 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:27.982112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:27.982692 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:27.982891 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:27.982896 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:27.983620 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:27.983621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:27.984660 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:27.984664 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:27.985228 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:27.985229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:27.985397 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:27.985876 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:27.985887 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:27.987827 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:27.989700 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:27.989708 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:27.989710 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:27.989931 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:27.990154 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:27.990154 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:27.990155 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:27.990259 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:27.990577 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:27.990582 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:27.990694 (+ 112us) client_negotiation.cc:769] Sending connection context
0812 01:14:27.990803 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 01:14:27.990991 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":106,"threads_started":1}
I20260812 01:14:27.991720 29907 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43571
I20260812 01:14:27.991839 29907 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:27.992065 29907 heartbeater.cc:511] Master 127.17.183.190:43571 requested a full tablet report, sending...
I20260812 01:14:27.992530 29338 ts_manager.cc:194] Registered new tserver with Master: 0d29775d69234b4fa0c3ca59918ff40e (127.17.183.130:37419)
I20260812 01:14:27.992901 29338 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:44061
WARNING: no policy specified for oryx/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab.
Entry for principal oryx/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab.
I20260812 01:14:28.017488 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43571
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab
--principal=oryx/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:42991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:28.102659 29914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:28.102916 29914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:28.102946 29914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:28.104089 29914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:28.104135 29914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:28.104192 29914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:28.105890 29914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:42991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab
--principal=oryx/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:28.106143 29914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:28.106382 29914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:28.111495 29922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:28.111470 29923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:28.111482 29927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:28.111794 29914 server_base.cc:1034] running on GCE node
I20260812 01:14:28.112057 29914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:28.112291 29914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:28.113451 29914 hybrid_clock.cc:648] HybridClock initialized: now 1786497268113436 us; error 34 us; skew 500 ppm
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:28.115978 29914 init.cc:377] Logged in from keytab as oryx/127.17.183.131@KRBTEST.COM (short username oryx)
I20260812 01:14:28.116389 29914 webserver.cc:460] Webserver started at http://127.17.183.131:34023/ using document root <none> and password file <none>
I20260812 01:14:28.116668 29914 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:28.116746 29914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:28.116906 29914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:28.118000 29914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "662e0c240da3421691e37816883b1fdb"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "a61e5c2fc7598ffd95df5d3d1a796419"
server_key_iv: "c2c5624a1b35405ed1cddb171d0612b7"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.118366 29914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "662e0c240da3421691e37816883b1fdb"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "a61e5c2fc7598ffd95df5d3d1a796419"
server_key_iv: "c2c5624a1b35405ed1cddb171d0612b7"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.119747 29914 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:28.120558 29945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.120785 29914 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:28.120891 29914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "662e0c240da3421691e37816883b1fdb"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "a61e5c2fc7598ffd95df5d3d1a796419"
server_key_iv: "c2c5624a1b35405ed1cddb171d0612b7"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.120981 29914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:28.129807 29914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:28.131537 29914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:28.131705 29914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:28.131944 29914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:28.132252 29914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:28.132306 29914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.132346 29914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:28.132375 29914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.138463 29914 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:36249
I20260812 01:14:28.138537 30156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:36249 every 8 connection(s)
I20260812 01:14:28.138857 29914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:28.143044 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 29914
I20260812 01:14:28.143149 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:28.143342 18142 external_mini_cluster.cc:1428] Setting key 8c347605ed73a5d7bff5771730534e33
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:28.147997 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.139608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:52963 (local address 127.17.183.190:43571)
0812 01:14:28.139681 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.139683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.139883 (+ 200us) server_negotiation.cc:407] Connection header received
0812 01:14:28.140380 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.140381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.140390 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.140447 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.141363 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.141851 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.142812 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.142992 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.143041 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.145631 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.145632 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.145633 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.145657 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.146856 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.147227 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.147228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.147228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.147293 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.147513 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.147513 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.147514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.147609 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.147659 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.147877 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.147936 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 01:14:28.148155 30162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.139584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.131:52963)
0812 01:14:28.139753 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.139797 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.140296 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.140521 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.140524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.141102 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.141283 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.141288 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.141933 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.141934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.142737 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.142739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.143077 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.143078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.143232 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.144008 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.144019 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.145546 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.146929 (+ 1383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.146935 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.146937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.147166 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.147352 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.147353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.147353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.147443 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.147664 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.147668 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.147770 (+ 102us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.147848 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.147958 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":91,"threads_started":1}
I20260812 01:14:28.148653 30157 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43571
I20260812 01:14:28.148741 30157 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:28.148880 30157 heartbeater.cc:511] Master 127.17.183.190:43571 requested a full tablet report, sending...
I20260812 01:14:28.149264 29338 ts_manager.cc:194] Registered new tserver with Master: 662e0c240da3421691e37816883b1fdb (127.17.183.131:36249)
I20260812 01:14:28.149603 29338 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:52963
I20260812 01:14:28.155221 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.183.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.189.keytab.
Entry for principal oryx/127.17.183.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.189.keytab.
I20260812 01:14:28.182621 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.189:46001
--webserver_interface=127.17.183.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.189.keytab
--principal=oryx/127.17.183.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:42991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:43571,127.17.183.189:46001
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:28.264793 30165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:28.265053 30165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:28.265090 30165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:28.266317 30165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:28.266378 30165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:28.266402 30165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:28.266429 30165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:28.266458 30165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:28.267943 30165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:42991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:43571,127.17.183.189:46001
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.189.keytab
--principal=oryx/127.17.183.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.189:46001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.183.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
W20260812 01:14:28.268085 30165 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.17.183.190:43571,127.17.183.189:46001'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 01:14:28.268241 30165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:28.268498 30165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:28.273928 30178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:28.273929 30175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:28.273978 30176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:28.274223 30165 server_base.cc:1034] running on GCE node
I20260812 01:14:28.274427 30165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:28.274657 30165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:28.275801 30165 hybrid_clock.cc:648] HybridClock initialized: now 1786497268275787 us; error 23 us; skew 500 ppm
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:28.278249 30165 init.cc:377] Logged in from keytab as oryx/127.17.183.189@KRBTEST.COM (short username oryx)
I20260812 01:14:28.278733 30165 webserver.cc:460] Webserver started at http://127.17.183.189:46555/ using document root <none> and password file <none>
I20260812 01:14:28.278996 30165 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:28.279066 30165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:28.279213 30165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:28.280246 30165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data/instance:
uuid: "9b1299fc1e6f47d285cc5b22def02bc7"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "c627df7556f2902a7ac95901c4e822c8"
server_key_iv: "ab69d9dd30a2eb62a5755735473ddead"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.280645 30165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/wal/instance:
uuid: "9b1299fc1e6f47d285cc5b22def02bc7"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "c627df7556f2902a7ac95901c4e822c8"
server_key_iv: "ab69d9dd30a2eb62a5755735473ddead"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.281924 30165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:28.282572 30192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.282735 30165 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:28.282840 30165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/wal
uuid: "9b1299fc1e6f47d285cc5b22def02bc7"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "c627df7556f2902a7ac95901c4e822c8"
server_key_iv: "ab69d9dd30a2eb62a5755735473ddead"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.282917 30165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:28.302414 30165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:28.304284 30165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:28.304453 30165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:28.308881 30165 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.189:46001
I20260812 01:14:28.308915 30295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.189:46001 every 8 connection(s)
I20260812 01:14:28.309327 30165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
I20260812 01:14:28.310320 30299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:28.311815 30299 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.189@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:28.317710 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 30165
I20260812 01:14:28.320616 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.312465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58572 (local address 127.17.183.190:43571)
0812 01:14:28.312567 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.312569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.312722 (+ 153us) server_negotiation.cc:407] Connection header received
0812 01:14:28.313183 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.313184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.313195 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.313250 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.313787 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.314265 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.315197 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.315370 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.315421 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.317423 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.317425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.317425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.317432 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.319034 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.319543 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.319544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.319544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.319605 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.319881 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.319882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.319882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.320018 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.320069 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.320387 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.320469 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 01:14:28.320755 30305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.312417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:58572)
0812 01:14:28.312608 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.312643 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.313060 (+ 417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.313301 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.313305 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.313532 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.313719 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.313723 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.314344 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.314345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.315127 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.315129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.315454 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.315455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.315550 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.315960 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.315967 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.317339 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.319112 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.319116 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.319118 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.319463 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.319672 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.319673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.319673 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.319815 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.320081 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.320086 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.320225 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.320343 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.320480 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":118,"threads_started":1}
I20260812 01:14:28.321482 30299 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.183.189@KRBTEST.COM
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.189@KRBTEST.COM for oryx/127.17.183.189@KRBTEST.COM
I20260812 01:14:28.327704 30309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.318262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35026 (local address 127.17.183.189:46001)
0812 01:14:28.318430 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.318435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.318461 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:14:28.318479 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.318480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.318490 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.318549 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.319267 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.320279 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.321348 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.321756 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.321861 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.324527 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.324534 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.324534 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.324539 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.326269 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.326802 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.326805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.326805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.326868 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.327070 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.327070 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.327071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.327247 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.327416 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.327523 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.327587 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":83,"threads_started":1}
I20260812 01:14:28.329068 30305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.321752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:46001 (local address 127.0.0.1:35034)
0812 01:14:28.321801 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.321811 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.321861 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.322255 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.322257 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.322399 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.322441 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.322443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.323382 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.323383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.324098 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.324102 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.324421 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.324422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.324521 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.324923 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.324927 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.326036 (+ 1109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.328164 (+ 2128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.328165 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.328165 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.328392 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.328581 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.328582 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.328582 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.328649 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.328864 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.328864 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.328896 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.328944 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.329013 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 01:14:28.329190 30310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.321781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35034 (local address 127.17.183.189:46001)
0812 01:14:28.322122 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.322123 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.322129 (+ 6us) server_negotiation.cc:407] Connection header received
0812 01:14:28.322145 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.322146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.322153 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.322235 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.322516 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.323295 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.324167 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.324345 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.324395 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.326116 (+ 1721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.326117 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.326117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.326123 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.328092 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.328446 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.328447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.328447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.328536 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.328701 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.328701 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.328701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.328799 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.328850 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.328959 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.329057 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":324,"thread_start_us":92,"threads_started":1}
I20260812 01:14:28.330497 30299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: Bootstrap starting.
I20260812 01:14:28.331117 30299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:28.331423 30299 log.cc:824] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:28.332177 30299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: No bootstrap required, opened a new log
I20260812 01:14:28.333746 30299 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } }
I20260812 01:14:28.333889 30299 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:28.333935 30299 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1299fc1e6f47d285cc5b22def02bc7, State: Initialized, Role: FOLLOWER
I20260812 01:14:28.334060 30299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } }
I20260812 01:14:28.334358 30299 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:28.334322 30314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } } }
I20260812 01:14:28.334450 30314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 01:14:28.335973 30334 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:14:28.336043 30334 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:14:28.337718 30165 master_runner.cc:428] Detected that this master 9b1299fc1e6f47d285cc5b22def02bc7 is joining an existing cluster
I20260812 01:14:28.337780 30165 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.183.189:46001
I20260812 01:14:28.345594 30310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.339106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35040 (local address 127.17.183.189:46001)
0812 01:14:28.339179 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.339180 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.339221 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:14:28.339308 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.339309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.339317 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.339342 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.339759 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.340453 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.341199 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.341422 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.341495 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.342552 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.342553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.342554 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.342560 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.344386 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.344769 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.344770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.344771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.344821 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.345030 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.345032 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.345032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.345149 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.345188 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.345377 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.345489 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 01:14:28.345862 30346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.339067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:46001 (local address 127.0.0.1:35040)
0812 01:14:28.339174 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.339183 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.339234 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.339392 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.339393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.339612 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.339673 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.339675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.340571 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.340572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.341118 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.341120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.341493 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.341494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.341551 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.342005 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.342010 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.342453 (+ 443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.344476 (+ 2023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.344477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.344478 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.344698 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.344897 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.344898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.344898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.344960 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.345242 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.345242 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.345276 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.345697 (+ 421us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.345800 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"mutex_wait_us":1,"thread_start_us":73,"threads_started":1}
I20260812 01:14:28.346349 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.338819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:58588)
0812 01:14:28.338976 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.338989 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.339053 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.339249 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.339250 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.339450 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.339512 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.339513 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.340459 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.340460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.341413 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.341416 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.341946 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.341947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.342026 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.342398 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.342403 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.342801 (+ 398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.344677 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.344678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.344679 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.344895 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.345100 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.345101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.345102 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.345177 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.345570 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.345571 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.345635 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.346143 (+ 508us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.346245 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":20,"thread_start_us":93,"threads_started":1}
I20260812 01:14:28.346361 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.338855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58588 (local address 127.17.183.190:43571)
0812 01:14:28.338917 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.338919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.339132 (+ 213us) server_negotiation.cc:407] Connection header received
0812 01:14:28.339161 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.339163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.339175 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.339246 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.339591 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.340367 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.341521 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.341826 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.341866 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.342895 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.342896 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.342897 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.342904 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.344597 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.344973 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.344974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.344974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.345030 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.345262 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.345263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.345264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.345446 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.345542 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.346179 (+ 637us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.346263 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497267, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.190@KRBTEST.COM for oryx/127.17.183.189@KRBTEST.COM
I20260812 01:14:28.356748 30310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.348997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35044 (local address 127.17.183.189:46001)
0812 01:14:28.349034 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.349036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.349210 (+ 174us) server_negotiation.cc:407] Connection header received
0812 01:14:28.349376 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.349377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.349387 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.349434 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.349879 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.350317 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.351090 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.351338 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.351416 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.354207 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.354209 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.354209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.354216 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.355540 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.355924 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.355925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.355925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.355982 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.356180 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.356181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.356181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.356288 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.356356 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.356561 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.356647 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 01:14:28.356828 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.348951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:46001 (local address 127.0.0.1:35044)
0812 01:14:28.349123 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.349152 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.349263 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.349449 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.349454 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.349738 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.349787 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.349789 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.350409 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.350410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.351001 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.351003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.351417 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.351419 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.351507 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.352678 (+ 1171us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.352683 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.354101 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.355641 (+ 1540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.355648 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.355650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.355849 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.356052 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.356053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.356053 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.356116 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.356349 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.356357 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.356407 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.356499 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.356676 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":65,"threads_started":1}
I20260812 01:14:28.357452 29338 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.183.189:46001: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7"
member_type: NON_VOTER
last_known_addr {
host: "127.17.183.189"
port: 46001
}
attrs {
promote: true
}
}
dest_uuid: "ecb17584ae4e4e51a5aa7f580ec47253"
cas_config_opid_index: -1
I20260812 01:14:28.357854 29338 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } }
I20260812 01:14:28.358359 30350 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 9b1299fc1e6f47d285cc5b22def02bc7 (127.17.183.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } } }
I20260812 01:14:28.358718 30253 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:28.359509 30350 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.183.189:46001
I20260812 01:14:28.359670 30348 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } } }
I20260812 01:14:28.359764 30348 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:28.359725 30253 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 FOLLOWER]: Refusing update from remote peer ecb17584ae4e4e51a5aa7f580ec47253: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 01:14:28.360101 30165 master.cc:537] Master@127.17.183.189:46001 shutting down...
I20260812 01:14:28.360124 30348 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 01:14:28.360940 29304 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 01:14:28.361420 29304 consensus_peers.cc:487] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 -> Peer 9b1299fc1e6f47d285cc5b22def02bc7 (127.17.183.189:46001): Couldn't send request to peer 9b1299fc1e6f47d285cc5b22def02bc7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 01:14:28.363533 30165 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:28.363647 30165 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:28.363701 30165 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: stopping tablet replica
I20260812 01:14:28.366487 30165 master.cc:552] Master@127.17.183.189:46001 shutdown complete.
I20260812 01:14:28.366546 30165 master_runner.cc:305] Clearing existing system tablet
I20260812 01:14:28.366678 30165 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:28.366734 30165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:28.367389 30165 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:28.367864 30357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.367985 30165 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:28.368039 30165 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.368064 30165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/wal
uuid: "9b1299fc1e6f47d285cc5b22def02bc7"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "c627df7556f2902a7ac95901c4e822c8"
server_key_iv: "ab69d9dd30a2eb62a5755735473ddead"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.368752 30165 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:28.370007 30165 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 01:14:28.370067 30165 log.cc:1196] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 01:14:28.370285 30165 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: Deleting consensus metadata
I20260812 01:14:28.370427 30165 master_runner.cc:315] Copying system tablet from 127.17.183.190:43571
I20260812 01:14:28.371013 30165 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: tablet copy: Beginning tablet copy session from remote peer at address 127.17.183.190:43571
I20260812 01:14:28.377030 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.371405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58598 (local address 127.17.183.190:43571)
0812 01:14:28.371454 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.371456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.371511 (+ 55us) server_negotiation.cc:407] Connection header received
0812 01:14:28.371592 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.371592 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.371602 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.371674 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.372000 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.372480 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.373246 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.373446 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.373520 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.374486 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.374488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.374488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.374495 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.375805 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.376141 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.376142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.376143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.376198 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.376418 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.376419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.376419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.376612 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.376690 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.376869 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.376941 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 01:14:28.377049 30366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.371319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:58598)
0812 01:14:28.371448 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.371461 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.371529 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.371680 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.371681 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.371857 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.371914 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.371916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.372615 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.372616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.373141 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.373142 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.373520 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.373521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.373594 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.374070 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.374074 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.374380 (+ 306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.375890 (+ 1510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.375891 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.375891 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.376066 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.376290 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.376291 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.376292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.376354 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.376692 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.376694 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.376748 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.376826 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.376937 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":78,"threads_started":1}
I20260812 01:14:28.377626 29376 tablet_copy_service.cc:140] P ecb17584ae4e4e51a5aa7f580ec47253: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 9b1299fc1e6f47d285cc5b22def02bc7 ({username='oryx', principal='oryx/127.17.183.189@KRBTEST.COM'} at 127.0.0.1:58598)
I20260812 01:14:28.377765 29376 tablet_copy_service.cc:161] P ecb17584ae4e4e51a5aa7f580ec47253: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 9b1299fc1e6f47d285cc5b22def02bc7 at {username='oryx', principal='oryx/127.17.183.189@KRBTEST.COM'} at 127.0.0.1:58598: session id = 9b1299fc1e6f47d285cc5b22def02bc7-00000000000000000000000000000000
I20260812 01:14:28.378650 29376 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 01:14:28.379276 30165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 01:14:28.380270 30165 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: tablet copy: Starting download of 0 data blocks...
I20260812 01:14:28.380440 30165 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: tablet copy: Starting download of 1 WAL segments...
I20260812 01:14:28.381464 30165 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 01:14:28.382284 29376 tablet_copy_service.cc:342] P ecb17584ae4e4e51a5aa7f580ec47253: Request end of tablet copy session 9b1299fc1e6f47d285cc5b22def02bc7-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.183.189@KRBTEST.COM'} at 127.0.0.1:58598
I20260812 01:14:28.382349 29376 tablet_copy_service.cc:433] P ecb17584ae4e4e51a5aa7f580ec47253: ending tablet copy session 9b1299fc1e6f47d285cc5b22def02bc7-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 9b1299fc1e6f47d285cc5b22def02bc7
I20260812 01:14:28.385151 30165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:28.386297 30368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:28.386407 30367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:28.386516 30372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:28.386564 30165 server_base.cc:1034] running on GCE node
I20260812 01:14:28.386704 30165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:28.386839 30165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:28.387964 30165 hybrid_clock.cc:648] HybridClock initialized: now 1786497268387954 us; error 23 us; skew 500 ppm
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:28.389345 30165 init.cc:377] Logged in from keytab as oryx/127.17.183.189@KRBTEST.COM (short username oryx)
I20260812 01:14:28.389632 30165 webserver.cc:460] Webserver started at http://127.17.183.189:38377/ using document root <none> and password file <none>
I20260812 01:14:28.389755 30165 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:28.389809 30165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:28.390416 30165 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:28.390992 30384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.391148 30165 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:28.391207 30165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/wal
uuid: "9b1299fc1e6f47d285cc5b22def02bc7"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "c627df7556f2902a7ac95901c4e822c8"
server_key_iv: "ab69d9dd30a2eb62a5755735473ddead"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.391263 30165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:28.416544 30165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:28.418064 30165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:28.421293 30165 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.189:46001
I20260812 01:14:28.421469 30474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.189:46001 every 8 connection(s)
I20260812 01:14:28.421665 30165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
I20260812 01:14:28.422544 30475 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:14:28.422976 30475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: Bootstrap starting.
I20260812 01:14:28.425416 30475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:14:28.425652 30475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: Bootstrap complete.
I20260812 01:14:28.425921 30475 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } }
I20260812 01:14:28.426013 30475 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b1299fc1e6f47d285cc5b22def02bc7, State: Initialized, Role: LEARNER
I20260812 01:14:28.426061 30475 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } }
I20260812 01:14:28.426308 30475 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:28.426280 30483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } } }
I20260812 01:14:28.426368 30483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: This master's current role is: LEARNER
I20260812 01:14:28.427836 30499 catalog_manager.cc:1259] Loaded cluster ID: b72805d0b192477988222afaeee3b72c
I20260812 01:14:28.427901 30499 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: loading cluster ID for follower catalog manager: success
I20260812 01:14:28.428902 30499 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: acquiring CA information for follower catalog manager: success
I20260812 01:14:28.429181 30499 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:14:28.436028 30500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.429580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35058 (local address 127.17.183.189:46001)
0812 01:14:28.429706 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.429708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.429715 (+ 7us) server_negotiation.cc:407] Connection header received
0812 01:14:28.429751 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.429752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.429760 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.429830 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.430383 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.431002 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.431771 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.432003 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.432079 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.433374 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.433376 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.433376 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.433383 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.434823 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.435182 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.435183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.435183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.435247 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.435467 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.435468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.435468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.435574 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.435700 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.435799 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.435898 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
WARNING: no policy specified for oryx/127.17.183.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.188.keytab.
Entry for principal oryx/127.17.183.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.188.keytab.
I20260812 01:14:28.465183 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.188:40543
--webserver_interface=127.17.183.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.188.keytab
--principal=oryx/127.17.183.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:42991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:43571,127.17.183.189:46001,127.17.183.188:40543
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:28.551134 30507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:28.551402 30507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:28.551440 30507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:28.552618 30507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:28.552654 30507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:28.552670 30507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:28.552682 30507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:28.552695 30507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:28.554263 30507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:42991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:43571,127.17.183.189:46001,127.17.183.188:40543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.188.keytab
--principal=oryx/127.17.183.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.188:40543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.183.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:28.554553 30507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:28.554838 30507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:28.559633 30522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:28.559697 30519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:28.559720 30517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:28.560021 30507 server_base.cc:1034] running on GCE node
I20260812 01:14:28.560307 30507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:28.560612 30507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:28.561779 30507 hybrid_clock.cc:648] HybridClock initialized: now 1786497268561765 us; error 30 us; skew 500 ppm
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:28.564466 30507 init.cc:377] Logged in from keytab as oryx/127.17.183.188@KRBTEST.COM (short username oryx)
I20260812 01:14:28.564924 30507 webserver.cc:460] Webserver started at http://127.17.183.188:44555/ using document root <none> and password file <none>
I20260812 01:14:28.565285 30507 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:28.565382 30507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:28.565518 30507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:28.566587 30507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data/instance:
uuid: "3a1986b4a35c4f75af2d22e0c7a5997c"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "b50d4a37294307638e7ac9ad759f1080"
server_key_iv: "a493aa55e4073e63cae620efec7cefd7"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.566898 30507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/wal/instance:
uuid: "3a1986b4a35c4f75af2d22e0c7a5997c"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "b50d4a37294307638e7ac9ad759f1080"
server_key_iv: "a493aa55e4073e63cae620efec7cefd7"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.568105 30507 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:28.568794 30533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.569002 30507 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:28.569077 30507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/wal
uuid: "3a1986b4a35c4f75af2d22e0c7a5997c"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "b50d4a37294307638e7ac9ad759f1080"
server_key_iv: "a493aa55e4073e63cae620efec7cefd7"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.569129 30507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:28.605777 30507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:28.608239 30507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:28.608351 30507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:28.613281 30507 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.188:40543
I20260812 01:14:28.613355 30627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.188:40543 every 8 connection(s)
I20260812 01:14:28.613715 30507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
I20260812 01:14:28.614710 30630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:28.616278 30630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:14:28.621603 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 30507
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.188@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:28.625833 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.617092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58614 (local address 127.17.183.190:43571)
0812 01:14:28.617189 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.617203 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.617450 (+ 247us) server_negotiation.cc:407] Connection header received
0812 01:14:28.617898 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.617900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.617909 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.617964 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.618673 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.619183 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.620145 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.620322 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.620371 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.622936 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.622938 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.622938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.622945 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.624413 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.624832 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.624833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.624833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.624900 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.625195 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.625196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.625196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.625306 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.625360 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.625679 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.625770 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 01:14:28.626133 30633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.617012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:58614)
0812 01:14:28.617286 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.617323 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.617804 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.618046 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.618050 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.618283 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.618469 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.618473 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.619266 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.619267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.620064 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.620065 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.620431 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.620433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.620650 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.621091 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.621099 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.622828 (+ 1729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.624489 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.624516 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.624519 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.624735 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.624985 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.624986 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.624986 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.625127 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.625371 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.625375 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.625524 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.625633 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.625779 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":166,"threads_started":1}
I20260812 01:14:28.626722 30630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.183.188@KRBTEST.COM
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.188@KRBTEST.COM for oryx/127.17.183.189@KRBTEST.COM
I20260812 01:14:28.631438 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.622166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48420 (local address 127.17.183.188:40543)
0812 01:14:28.622307 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.622316 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.622330 (+ 14us) server_negotiation.cc:407] Connection header received
0812 01:14:28.622348 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.622350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.622365 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.622431 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.623086 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.624133 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.625006 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.625434 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.625498 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.628390 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.628398 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.628398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.628404 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.630176 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.630556 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.630559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.630559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.630660 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.630874 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.630875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.630875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.631016 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.631178 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.631251 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.631336 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":87,"threads_started":1}
I20260812 01:14:28.633792 30633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.627009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:46001 (local address 127.0.0.1:35062)
0812 01:14:28.627058 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.627070 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.627114 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.627335 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.627336 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.627496 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.627545 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.627547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.628368 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.628369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.628926 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.628928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.629365 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.629366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.629437 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.629807 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.629811 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.631021 (+ 1210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.632820 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.632821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.632821 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.632983 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.633192 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.633193 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.633193 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.633255 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.633500 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.633501 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.633547 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.633622 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.633707 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 01:14:28.633837 30500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.627090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35062 (local address 127.17.183.189:46001)
0812 01:14:28.627160 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.627163 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.627173 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:28.627205 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.627207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.627222 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.627312 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.627634 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.628266 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.629027 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.629244 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.629363 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.631109 (+ 1746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.631110 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.631111 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.631118 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.632745 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.633058 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.633059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.633059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.633115 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.633320 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.633321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.633322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.633429 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.633495 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.633661 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.633745 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 01:14:28.634305 30630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.188@KRBTEST.COM for oryx/127.17.183.188@KRBTEST.COM
I20260812 01:14:28.639976 30633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.634526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:40543 (local address 127.0.0.1:48426)
0812 01:14:28.634567 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.634577 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.634620 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.634730 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.634731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.634831 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.634857 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.634858 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.635419 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.635420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.635869 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.635871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.636169 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.636170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.636207 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.636556 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.636560 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.637534 (+ 974us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.639113 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.639114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.639114 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.639280 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.639477 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.639478 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.639479 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.639530 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.639759 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.639760 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.639794 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.639844 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.639916 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 01:14:28.640034 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.634552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48426 (local address 127.17.183.188:40543)
0812 01:14:28.634601 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.634603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.634612 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:28.634671 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.634672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.634680 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.634726 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.634908 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.635341 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.635934 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.636109 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.636156 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.637603 (+ 1447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.637605 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.637605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.637610 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.639024 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.639355 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.639355 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.639356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.639405 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.639591 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.639592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.639593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.639701 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.639763 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.639858 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.639960 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":31}
I20260812 01:14:28.641402 30630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: Bootstrap starting.
I20260812 01:14:28.642244 30630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:28.642536 30630 log.cc:824] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:28.643271 30630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: No bootstrap required, opened a new log
I20260812 01:14:28.644784 30630 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } }
I20260812 01:14:28.644906 30630 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:28.644948 30630 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a1986b4a35c4f75af2d22e0c7a5997c, State: Initialized, Role: FOLLOWER
I20260812 01:14:28.645084 30630 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } }
I20260812 01:14:28.645373 30630 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:28.645341 30636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } } }
I20260812 01:14:28.645445 30636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: This master's current role is: FOLLOWER
W20260812 01:14:28.647395 30654 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:14:28.647596 30654 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:14:28.649767 30507 master_runner.cc:428] Detected that this master 3a1986b4a35c4f75af2d22e0c7a5997c is joining an existing cluster
I20260812 01:14:28.649837 30507 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.183.188:40543
I20260812 01:14:28.658555 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.651388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48442 (local address 127.17.183.188:40543)
0812 01:14:28.651421 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.651423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.651871 (+ 448us) server_negotiation.cc:407] Connection header received
0812 01:14:28.651914 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.651914 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.651923 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.651979 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.652462 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.653190 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.654251 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.654530 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.654567 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.656058 (+ 1491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.656059 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.656059 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.656064 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.657477 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.657874 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.657875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.657875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.657925 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.658131 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.658131 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.658131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.658226 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.658279 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.658432 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.658496 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":16}
I20260812 01:14:28.658741 30666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.651237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:40543 (local address 127.0.0.1:48442)
0812 01:14:28.651720 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.651731 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.651860 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.652009 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.652010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.652289 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.652375 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.652377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.653280 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.653281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.654159 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.654162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.654667 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.654667 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.654723 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.655516 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.655520 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.655972 (+ 452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.657556 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.657557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.657558 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.657799 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.657988 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.657989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.657990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.658067 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.658294 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.658295 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.658339 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.658417 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.658588 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":64,"thread_start_us":73,"threads_started":1}
I20260812 01:14:28.681169 30664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.651191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:58616)
0812 01:14:28.651365 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.651378 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.651707 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.651906 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.651907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.652289 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.652398 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.652399 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.653358 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.653359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.654233 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.654235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.654732 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.654733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.654805 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.677272 (+ 22467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.677277 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.677908 (+ 631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.679971 (+ 2063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.679971 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.679972 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.680221 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.680437 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.680438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.680438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.680560 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.680864 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.680865 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.680928 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.680995 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.681089 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":78,"threads_started":1}
I20260812 01:14:28.681218 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.651230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58616 (local address 127.17.183.190:43571)
0812 01:14:28.651290 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.651292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.651674 (+ 382us) server_negotiation.cc:407] Connection header received
0812 01:14:28.651788 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.651789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.651803 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.651833 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.652513 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.653266 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.654328 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.654626 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.654663 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.678037 (+ 23374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.678039 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.678039 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.678048 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.679884 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.680298 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.680299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.680299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.680361 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.680630 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.680631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.680631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.680780 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.680853 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.681039 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.681122 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 01:14:28.681663 30500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.651751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35076 (local address 127.17.183.189:46001)
0812 01:14:28.651794 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.651796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.652297 (+ 501us) server_negotiation.cc:407] Connection header received
0812 01:14:28.652404 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.652405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.652417 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.652448 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.652907 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.653618 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.654577 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.655111 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.655147 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.678074 (+ 22927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.678076 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.678076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.678085 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.679782 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.680294 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.680295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.680296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.680354 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.680660 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.680661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.680662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.680789 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.680877 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.681485 (+ 608us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.681568 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:14:28.681980 30665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.651412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:46001 (local address 127.0.0.1:35076)
0812 01:14:28.652090 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.652100 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.652329 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.652549 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.652549 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.652737 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.652814 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.652816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.653708 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.653709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.654495 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.654496 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.655212 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.655212 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.655294 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.677191 (+ 21897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.677197 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.677908 (+ 711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.679897 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.679898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.679899 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.680185 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.680446 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.680446 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.680447 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.680574 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.681295 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.681296 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.681346 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.681759 (+ 413us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.681877 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"mutex_wait_us":3,"thread_start_us":220,"threads_started":1}
I20260812 01:14:28.683338 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 29442
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497267, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.190@KRBTEST.COM for oryx/127.17.183.188@KRBTEST.COM
I20260812 01:14:28.705137 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:45743
--local_ip_for_outbound_sockets=127.17.183.129
--tserver_master_addrs=127.17.183.190:43571
--webserver_port=39513
--webserver_interface=127.17.183.129
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab
--principal=oryx/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:42991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.183.190:43571,127.17.183.189:46001
--tserver_master_addrs=127.17.183.190:43571,127.17.183.189:46001,127.17.183.188:40543 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:14:28.706861 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.699752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48458 (local address 127.17.183.188:40543)
0812 01:14:28.699825 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.699828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.699838 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:28.699886 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.699888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.699900 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.699968 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.700429 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.700985 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.701716 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.701905 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.701975 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.703923 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.703925 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.703925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.703932 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.705610 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.705974 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.705975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.705975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.706034 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.706258 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.706259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.706259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.706378 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.706444 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.706636 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.706724 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 01:14:28.707239 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.690502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:40543 (local address 127.0.0.1:48458)
0812 01:14:28.690593 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.690604 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.690637 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.700038 (+ 9401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.700040 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.700279 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.700335 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.700342 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.701083 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.701085 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.701617 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.701618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.701988 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.701989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.702061 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.702527 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.702533 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.703824 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.705692 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.705694 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.705694 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.705896 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.706128 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.706128 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.706129 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.706191 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.706451 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.706453 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.706504 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.706995 (+ 491us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.707117 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 01:14:28.707859 29338 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.183.188:40543: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c"
member_type: NON_VOTER
last_known_addr {
host: "127.17.183.188"
port: 40543
}
attrs {
promote: true
}
}
dest_uuid: "ecb17584ae4e4e51a5aa7f580ec47253"
cas_config_opid_index: 5
I20260812 01:14:28.708129 29338 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } }
I20260812 01:14:28.708541 30350 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3a1986b4a35c4f75af2d22e0c7a5997c (127.17.183.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:28.709051 30593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:28.709652 30350 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.183.188:40543
I20260812 01:14:28.709744 30350 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:28.709816 30350 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:28.710256 30507 master.cc:537] Master@127.17.183.188:40543 shutting down...
I20260812 01:14:28.710580 30593 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 FOLLOWER]: Refusing update from remote peer ecb17584ae4e4e51a5aa7f580ec47253: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 01:14:28.711459 30348 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 01:14:28.712939 29303 consensus_peers.cc:487] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 -> Peer 3a1986b4a35c4f75af2d22e0c7a5997c (127.17.183.188:40543): Couldn't send request to peer 3a1986b4a35c4f75af2d22e0c7a5997c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 01:14:28.714828 30500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.709902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35092 (local address 127.17.183.189:46001)
0812 01:14:28.709969 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.709971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.710922 (+ 951us) server_negotiation.cc:407] Connection header received
0812 01:14:28.711021 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.711023 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.711052 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.711094 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:28.711297 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.712033 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.713538 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.714330 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.714390 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.714484 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.714711 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.714765 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 01:14:28.715029 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.708618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:46001 (local address 127.0.0.1:35092)
0812 01:14:28.710865 (+ 2247us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.710877 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.710951 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.711174 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.711175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.711177 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:28.711220 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.711221 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.712138 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.712139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.713426 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.713429 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.714543 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.714544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.714605 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.714628 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.714913 (+ 285us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.714958 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2232}
I20260812 01:14:28.715281 30422 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 LEARNER]: Refusing update from remote peer ecb17584ae4e4e51a5aa7f580ec47253: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 01:14:28.715488 30348 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 01:14:28.715894 30507 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:28.715975 30507 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:28.716023 30507 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: stopping tablet replica
I20260812 01:14:28.716065 30422 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3a1986b4a35c4f75af2d22e0c7a5997c (127.17.183.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:28.717363 30483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ecb17584ae4e4e51a5aa7f580ec47253. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:28.717463 30483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: This master's current role is: LEARNER
I20260812 01:14:28.717505 30483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: NON_VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: true } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:28.717554 30483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: This master's current role is: LEARNER
I20260812 01:14:28.718411 30348 raft_consensus.cc:1050] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253: attempting to promote NON_VOTER 9b1299fc1e6f47d285cc5b22def02bc7 to VOTER
I20260812 01:14:28.718636 30348 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } }
I20260812 01:14:28.719177 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.719052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:40543 (local address 127.0.0.1:48460)
0812 01:14:28.719103 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.719149 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:40543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 01:14:28.719252 30422 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 LEARNER]: Refusing update from remote peer ecb17584ae4e4e51a5aa7f580ec47253: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 01:14:28.719463 30674 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 01:14:28.719656 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.719570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:40543 (local address 127.0.0.1:48462)
0812 01:14:28.719603 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.719627 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:40543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 01:14:28.719719 29303 consensus_peers.cc:487] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 -> Peer 3a1986b4a35c4f75af2d22e0c7a5997c (127.17.183.188:40543): Couldn't send request to peer 3a1986b4a35c4f75af2d22e0c7a5997c. Status: Network error: Client connection negotiation failed: client connection to 127.17.183.188:40543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 01:14:28.720221 30348 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 9b1299fc1e6f47d285cc5b22def02bc7 (127.17.183.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:28.720481 30422 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 9b1299fc1e6f47d285cc5b22def02bc7 (127.17.183.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:28.721302 30348 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:28.721379 30348 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:28.721354 30350 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:28.721407 30350 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:28.721518 30671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:28.721606 30671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:14:28.729146 30507 master.cc:552] Master@127.17.183.188:40543 shutdown complete.
I20260812 01:14:28.729199 30507 master_runner.cc:305] Clearing existing system tablet
I20260812 01:14:28.729355 30507 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:28.729403 30507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:28.730111 30507 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:28.730628 30679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.730794 30507 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:28.730854 30507 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.730885 30507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/wal
uuid: "3a1986b4a35c4f75af2d22e0c7a5997c"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "b50d4a37294307638e7ac9ad759f1080"
server_key_iv: "a493aa55e4073e63cae620efec7cefd7"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.731618 30507 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:28.732928 30507 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 01:14:28.733017 30507 log.cc:1196] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 01:14:28.733232 30507 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: Deleting consensus metadata
I20260812 01:14:28.733412 30507 master_runner.cc:315] Copying system tablet from 127.17.183.190:43571
I20260812 01:14:28.734059 30507 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: tablet copy: Beginning tablet copy session from remote peer at address 127.17.183.190:43571
I20260812 01:14:28.743000 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.736815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58620 (local address 127.17.183.190:43571)
0812 01:14:28.736880 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.736882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.737048 (+ 166us) server_negotiation.cc:407] Connection header received
0812 01:14:28.737100 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.737101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.737112 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.737173 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.737496 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.738004 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.738740 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.738967 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.739044 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.740076 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.740078 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.740079 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.740087 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.741679 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.742046 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.742048 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.742048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.742109 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.742360 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.742361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.742362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.742537 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.742658 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.742836 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.742909 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:14:28.743017 30699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.736740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:58620)
0812 01:14:28.736962 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.736976 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.737041 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.737178 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.737179 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.737370 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.737413 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.737415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.738096 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.738098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.738649 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.738651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.739045 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.739046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.739103 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.739634 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.739639 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.739962 (+ 323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.741777 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.741779 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.741779 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.741972 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.742202 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.742202 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.742203 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.742268 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.742652 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.742653 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.742707 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.742792 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.742909 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":121,"threads_started":1}
I20260812 01:14:28.743506 29376 tablet_copy_service.cc:140] P ecb17584ae4e4e51a5aa7f580ec47253: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3a1986b4a35c4f75af2d22e0c7a5997c ({username='oryx', principal='oryx/127.17.183.188@KRBTEST.COM'} at 127.0.0.1:58620)
I20260812 01:14:28.743566 29376 tablet_copy_service.cc:161] P ecb17584ae4e4e51a5aa7f580ec47253: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3a1986b4a35c4f75af2d22e0c7a5997c at {username='oryx', principal='oryx/127.17.183.188@KRBTEST.COM'} at 127.0.0.1:58620: session id = 3a1986b4a35c4f75af2d22e0c7a5997c-00000000000000000000000000000000
I20260812 01:14:28.744027 29376 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 01:14:28.744556 30507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 01:14:28.745848 30507 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: tablet copy: Starting download of 0 data blocks...
I20260812 01:14:28.746004 30507 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: tablet copy: Starting download of 1 WAL segments...
I20260812 01:14:28.746807 30507 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 01:14:28.747640 29376 tablet_copy_service.cc:342] P ecb17584ae4e4e51a5aa7f580ec47253: Request end of tablet copy session 3a1986b4a35c4f75af2d22e0c7a5997c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.183.188@KRBTEST.COM'} at 127.0.0.1:58620
I20260812 01:14:28.747714 29376 tablet_copy_service.cc:433] P ecb17584ae4e4e51a5aa7f580ec47253: ending tablet copy session 3a1986b4a35c4f75af2d22e0c7a5997c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3a1986b4a35c4f75af2d22e0c7a5997c
I20260812 01:14:28.750105 30507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:28.751266 30711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:28.751328 30703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:28.751788 30507 server_base.cc:1034] running on GCE node
W20260812 01:14:28.753175 30704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:28.753343 30507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:28.753508 30507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:28.754637 30507 hybrid_clock.cc:648] HybridClock initialized: now 1786497268754629 us; error 26 us; skew 500 ppm
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:28.755990 30507 init.cc:377] Logged in from keytab as oryx/127.17.183.188@KRBTEST.COM (short username oryx)
I20260812 01:14:28.756299 30507 webserver.cc:460] Webserver started at http://127.17.183.188:42687/ using document root <none> and password file <none>
I20260812 01:14:28.756417 30507 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:28.756451 30507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:28.757102 30507 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.757649 30728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.757797 30507 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:28.757843 30507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/wal
uuid: "3a1986b4a35c4f75af2d22e0c7a5997c"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "b50d4a37294307638e7ac9ad759f1080"
server_key_iv: "a493aa55e4073e63cae620efec7cefd7"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.757905 30507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:28.769896 30507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:28.771720 30507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:28.775008 30507 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.188:40543
I20260812 01:14:28.775390 30507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
I20260812 01:14:28.776173 30813 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:14:28.776684 30813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: Bootstrap starting.
I20260812 01:14:28.778970 30813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:14:28.779211 30813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: Bootstrap complete.
I20260812 01:14:28.779450 30813 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } }
I20260812 01:14:28.779546 30813 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3a1986b4a35c4f75af2d22e0c7a5997c, State: Initialized, Role: LEARNER
I20260812 01:14:28.779594 30813 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } }
I20260812 01:14:28.779785 30813 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:28.779763 30820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:28.779990 30820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: This master's current role is: LEARNER
I20260812 01:14:28.781315 30841 catalog_manager.cc:1259] Loaded cluster ID: b72805d0b192477988222afaeee3b72c
I20260812 01:14:28.782100 30841 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: loading cluster ID for follower catalog manager: success
I20260812 01:14:28.782863 30841 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: acquiring CA information for follower catalog manager: success
I20260812 01:14:28.783128 30841 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:14:28.784590 30811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.188:40543 every 8 connection(s)
W20260812 01:14:28.826845 30668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:28.827090 30668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:28.827122 30668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:28.828838 30668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:28.828902 30668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:28.828938 30668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:28.831307 30668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:42991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab
--principal=oryx/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:45743
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=39513
--tserver_master_addrs=127.17.183.190:43571,127.17.183.189:46001,127.17.183.188:40543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:28.831550 30668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:28.831797 30668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:28.836913 30851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:28.837009 30850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:28.837119 30855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:28.837227 30668 server_base.cc:1034] running on GCE node
I20260812 01:14:28.837450 30668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:28.837718 30668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:28.838899 30668 hybrid_clock.cc:648] HybridClock initialized: now 1786497268838881 us; error 35 us; skew 500 ppm
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:28.841794 30668 init.cc:377] Logged in from keytab as oryx/127.17.183.129@KRBTEST.COM (short username oryx)
I20260812 01:14:28.842281 30668 webserver.cc:460] Webserver started at http://127.17.183.129:39513/ using document root <none> and password file <none>
I20260812 01:14:28.842549 30668 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:28.842633 30668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:28.844185 30668 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:14:28.844866 30866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.845036 30668 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.845141 30668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "2519cfbc421d4a77aaf37acbface3339"
format_stamp: "Formatted at 2026-08-12 01:14:27 on dist-test-slave-rwrg"
server_key: "3747a6ebe0248546d9f2e01b716deaf8"
server_key_iv: "f868705be6a8d6dc0e130ab0a05db712"
server_key_version: "encryptionkey@0"
I20260812 01:14:28.845472 30668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:28.865291 30668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:28.868152 30668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:28.868376 30668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:28.868767 30668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:28.869159 30668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:28.869220 30668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.869270 30668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:28.869319 30668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:28.879801 30668 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:45743
I20260812 01:14:28.879938 31084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:45743 every 8 connection(s)
I20260812 01:14:28.880333 30668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:14:28.882622 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 30668
I20260812 01:14:28.882795 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 29675
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:28.905061 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:37419
--local_ip_for_outbound_sockets=127.17.183.130
--tserver_master_addrs=127.17.183.190:43571
--webserver_port=44273
--webserver_interface=127.17.183.130
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab
--principal=oryx/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:42991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.183.190:43571,127.17.183.189:46001
--tserver_master_addrs=127.17.183.190:43571,127.17.183.189:46001,127.17.183.188:40543 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.188@KRBTEST.COM
Aug 12 01:14:28 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497268, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.189@KRBTEST.COM
I20260812 01:14:28.909626 31099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.881563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.129:57707)
0812 01:14:28.881694 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.881705 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.896469 (+ 14764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.896916 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.896920 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.898551 (+ 1631us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.898706 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.898709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.900979 (+ 2270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.900980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.902132 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.902136 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.902697 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.902698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.902804 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.903389 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.903395 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.905510 (+ 2115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.907631 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.907640 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.907642 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.908084 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.908327 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.908328 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.908328 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.908485 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.908867 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.908874 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.909053 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.909163 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.909366 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
I20260812 01:14:28.910048 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.881651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:57707 (local address 127.17.183.190:43571)
0812 01:14:28.881705 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.881707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.881756 (+ 49us) server_negotiation.cc:407] Connection header received
0812 01:14:28.896673 (+ 14917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.896675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.896693 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.896732 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.900076 (+ 3344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.900877 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.902234 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.902572 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.902615 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.905622 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.905624 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.905624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.905632 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.907540 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.908194 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.908195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.908196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.908253 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.908606 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.908607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.908607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.908766 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.908835 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.909816 (+ 981us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.909914 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 01:14:28.910295 31097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.881220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:40543 (local address 127.17.183.129:47099)
0812 01:14:28.881612 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.881622 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.896577 (+ 14955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.896914 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.896918 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.897299 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.897893 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.897902 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.899787 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.899788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.901196 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.901198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.901807 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.901808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.901960 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.902573 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.902608 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.906675 (+ 4067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.908901 (+ 2226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.908903 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.908903 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.909129 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.909392 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.909393 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.909393 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.909469 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.909956 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.909957 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.910004 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.910065 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.910181 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":4,"thread_start_us":133,"threads_started":1}
I20260812 01:14:28.910599 31087 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43571
I20260812 01:14:28.910698 31087 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:28.910810 31096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.881303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:47099 (local address 127.17.183.188:40543)
0812 01:14:28.881536 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.881538 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.881747 (+ 209us) server_negotiation.cc:407] Connection header received
0812 01:14:28.896705 (+ 14958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.896707 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.896723 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.896776 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.898817 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.899526 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.901338 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.901659 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.901737 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.906780 (+ 5043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.906782 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.906782 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.906791 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.908793 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.909217 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.909218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.909218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.909301 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.909551 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.909552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.909552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.909702 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.909930 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.910624 (+ 694us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.910723 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":53,"threads_started":1}
I20260812 01:14:28.910905 31087 heartbeater.cc:511] Master 127.17.183.190:43571 requested a full tablet report, sending...
I20260812 01:14:28.911131 31086 heartbeater.cc:347] Connected to a master server at 127.17.183.188:40543
I20260812 01:14:28.911178 31086 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:28.911237 31086 heartbeater.cc:511] Master 127.17.183.188:40543 requested a full tablet report, sending...
I20260812 01:14:28.911334 29338 ts_manager.cc:194] Re-registered known tserver with Master: 2519cfbc421d4a77aaf37acbface3339 (127.17.183.129:45743)
I20260812 01:14:28.911592 30762 ts_manager.cc:194] Registered new tserver with Master: 2519cfbc421d4a77aaf37acbface3339 (127.17.183.129:45743)
I20260812 01:14:28.911775 29338 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:57707
I20260812 01:14:28.913941 31094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.881220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:46001 (local address 127.17.183.129:36807)
0812 01:14:28.881408 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:28.881453 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:28.896459 (+ 15006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:28.899601 (+ 3142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:28.899602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:28.899782 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:28.899953 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.899955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.901115 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.901116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.901972 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:28.901974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.902505 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.902505 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:28.902617 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.903220 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:28.903225 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:28.907834 (+ 4609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:28.912692 (+ 4858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.912693 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.912694 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.912859 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.913109 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:28.913109 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:28.913110 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:28.913189 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:28.913570 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:28.913572 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:28.913612 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 01:14:28.913674 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 01:14:28.913759 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":101,"threads_started":1}
I20260812 01:14:28.914016 30500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:28.881220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:36807 (local address 127.17.183.189:46001)
0812 01:14:28.881284 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:28.881286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:28.881597 (+ 311us) server_negotiation.cc:407] Connection header received
0812 01:14:28.898094 (+ 16497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:28.898096 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:28.898112 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:28.898150 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:28.900058 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.900903 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.902063 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:28.902369 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:28.902416 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:28.907930 (+ 5514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:28.907931 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:28.907932 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:28.907940 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:28.909767 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.912941 (+ 3174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.912942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.912943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.913019 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:28.913276 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:28.913277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:28.913278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:28.913463 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:28.913552 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:28.913766 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 01:14:28.913858 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 01:14:28.914374 31088 heartbeater.cc:347] Connected to a master server at 127.17.183.189:46001
I20260812 01:14:28.914436 31088 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:28.914525 31088 heartbeater.cc:511] Master 127.17.183.189:46001 requested a full tablet report, sending...
I20260812 01:14:28.914958 30406 ts_manager.cc:194] Registered new tserver with Master: 2519cfbc421d4a77aaf37acbface3339 (127.17.183.129:45743)
W20260812 01:14:28.995311 31100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:28.995510 31100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:28.995533 31100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:28.996611 31100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:28.996644 31100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:28.996670 31100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:28.998054 31100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:42991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab
--principal=oryx/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:37419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=44273
--tserver_master_addrs=127.17.183.190:43571,127.17.183.189:46001,127.17.183.188:40543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:28.998267 31100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:28.998449 31100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:29.003551 31112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:29.003527 31107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:29.003527 31109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:29.003561 31100 server_base.cc:1034] running on GCE node
I20260812 01:14:29.004060 31100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:29.004292 31100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:29.005453 31100 hybrid_clock.cc:648] HybridClock initialized: now 1786497269005420 us; error 50 us; skew 500 ppm
Aug 12 01:14:29 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497269, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:29.008713 31100 init.cc:377] Logged in from keytab as oryx/127.17.183.130@KRBTEST.COM (short username oryx)
I20260812 01:14:29.009181 31100 webserver.cc:460] Webserver started at http://127.17.183.130:44273/ using document root <none> and password file <none>
I20260812 01:14:29.009435 31100 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:29.009495 31100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:29.010871 31100 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:29.011507 31127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:29.011699 31100 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:29.011790 31100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "0d29775d69234b4fa0c3ca59918ff40e"
format_stamp: "Formatted at 2026-08-12 01:14:27 on dist-test-slave-rwrg"
server_key: "2c869b1ceb5d84e6441c8da330f0b27c"
server_key_iv: "dda2653d7c01a01a3c78464f13bf3595"
server_key_version: "encryptionkey@0"
I20260812 01:14:29.012116 31100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:29.041949 31100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:29.043977 31100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:29.044138 31100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:29.044418 31100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:29.044762 31100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:29.044797 31100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:29.044839 31100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:29.044865 31100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:29.053781 31100 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:37419
I20260812 01:14:29.053841 31332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:37419 every 8 connection(s)
I20260812 01:14:29.054189 31100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
Aug 12 01:14:29 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497269, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
Aug 12 01:14:29 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497269, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.189@KRBTEST.COM
Aug 12 01:14:29 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497269, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.188@KRBTEST.COM
I20260812 01:14:29.064201 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 31100
I20260812 01:14:29.064370 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 29914
I20260812 01:14:29.065598 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.054977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:54329 (local address 127.17.183.190:43571)
0812 01:14:29.055034 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.055037 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.055294 (+ 257us) server_negotiation.cc:407] Connection header received
0812 01:14:29.056586 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.056587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.056598 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.056663 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.057450 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.058196 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.059340 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.059660 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.059734 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.062036 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.062038 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.062038 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.062045 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.063859 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.064443 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.064445 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.064445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.064529 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.064835 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.064836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.064836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.064976 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.065023 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.065418 (+ 395us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.065502 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 01:14:29.066016 30500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.055474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:57991 (local address 127.17.183.189:46001)
0812 01:14:29.055541 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.055543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.055553 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:29.056686 (+ 1133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.056687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.056700 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.056760 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.057451 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.058230 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.059202 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.059491 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.059560 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.062975 (+ 3415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.062977 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.062977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.062984 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.064783 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.065172 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.065174 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.065174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.065230 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.065429 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.065430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.065430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.065566 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.065611 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.065825 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.065935 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 01:14:29.066452 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.054973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.130:54329)
0812 01:14:29.055178 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.055207 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.056337 (+ 1130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.056693 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.056698 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.057142 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:29.057332 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.057339 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.058295 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.058296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.059242 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.059245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.059737 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.059738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.059806 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.060331 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:29.060342 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:29.061937 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:29.063943 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.063953 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.063955 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.064332 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.064615 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.064616 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.064617 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.064753 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.065089 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:29.065097 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:29.065255 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.065892 (+ 637us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.066209 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":92,"thread_start_us":121,"threads_started":1}
I20260812 01:14:29.066453 31342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.055307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:46001 (local address 127.17.183.130:57991)
0812 01:14:29.055426 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.055435 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.056344 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.056764 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.056765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.057149 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:29.057332 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.057339 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.058316 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.058317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.059091 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.059093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.059576 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.059576 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.059753 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.060523 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:29.060529 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:29.062871 (+ 2342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:29.064862 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.064863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.064864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.065052 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.065301 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.065302 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.065302 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.065357 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.065665 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:29.065666 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:29.065705 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.066109 (+ 404us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.066252 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":93,"thread_start_us":62,"threads_started":1}
I20260812 01:14:29.085055 31334 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43571
I20260812 01:14:29.085063 31336 heartbeater.cc:347] Connected to a master server at 127.17.183.189:46001
I20260812 01:14:29.085212 31334 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:29.085494 31334 heartbeater.cc:511] Master 127.17.183.190:43571 requested a full tablet report, sending...
I20260812 01:14:29.085582 31096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.054967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:43377 (local address 127.17.183.188:40543)
0812 01:14:29.055016 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.055018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.055292 (+ 274us) server_negotiation.cc:407] Connection header received
0812 01:14:29.056459 (+ 1167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.056460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.056477 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.056600 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.057428 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.057932 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.059419 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.059734 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.059802 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.062925 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.062926 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.062927 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.062934 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.064683 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.084203 (+ 19520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.084205 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.084205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.084296 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.084657 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.084659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.084659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.084878 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.084948 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.085295 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.085422 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:14:29.085213 31336 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:29.085764 31341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.054974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:40543 (local address 127.17.183.130:43377)
0812 01:14:29.055165 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.055207 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.056340 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.056693 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.056698 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.057057 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:29.057332 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.057337 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.058090 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.058091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.059336 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.059338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.059857 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.059858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.059934 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.060731 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:29.060736 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:29.062816 (+ 2080us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:29.083701 (+ 20885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.083703 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.083704 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.084014 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.084438 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.084440 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.084440 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.084561 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.084982 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:29.084983 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:29.085045 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.085122 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.085276 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":70,"thread_start_us":126,"threads_started":1}
I20260812 01:14:29.085793 31336 heartbeater.cc:511] Master 127.17.183.189:46001 requested a full tablet report, sending...
I20260812 01:14:29.086473 29338 ts_manager.cc:194] Re-registered known tserver with Master: 0d29775d69234b4fa0c3ca59918ff40e (127.17.183.130:37419)
I20260812 01:14:29.086563 31333 heartbeater.cc:347] Connected to a master server at 127.17.183.188:40543
I20260812 01:14:29.086613 31333 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:29.086661 31333 heartbeater.cc:511] Master 127.17.183.188:40543 requested a full tablet report, sending...
I20260812 01:14:29.086962 30762 ts_manager.cc:194] Registered new tserver with Master: 0d29775d69234b4fa0c3ca59918ff40e (127.17.183.130:37419)
I20260812 01:14:29.087028 29338 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:54329
I20260812 01:14:29.087286 30406 ts_manager.cc:194] Registered new tserver with Master: 0d29775d69234b4fa0c3ca59918ff40e (127.17.183.130:37419)
I20260812 01:14:29.088786 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:36249
--local_ip_for_outbound_sockets=127.17.183.131
--tserver_master_addrs=127.17.183.190:43571
--webserver_port=34023
--webserver_interface=127.17.183.131
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab
--principal=oryx/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:42991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.183.190:43571,127.17.183.189:46001
--tserver_master_addrs=127.17.183.190:43571,127.17.183.189:46001,127.17.183.188:40543 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:29.173450 31345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:29.173697 31345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:29.173740 31345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:29.175030 31345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:29.175117 31345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:29.175165 31345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:29.177107 31345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:42991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab
--principal=oryx/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:36249
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=34023
--tserver_master_addrs=127.17.183.190:43571,127.17.183.189:46001,127.17.183.188:40543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:29.177417 31345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:29.177676 31345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:29.183205 31357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:29.183216 31354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:29.183211 31355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:29.183473 31345 server_base.cc:1034] running on GCE node
I20260812 01:14:29.183763 31345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:29.184011 31345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:29.185189 31345 hybrid_clock.cc:648] HybridClock initialized: now 1786497269185174 us; error 32 us; skew 500 ppm
Aug 12 01:14:29 dist-test-slave-rwrg krb5kdc[29260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497269, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:29.187804 31345 init.cc:377] Logged in from keytab as oryx/127.17.183.131@KRBTEST.COM (short username oryx)
I20260812 01:14:29.188287 31345 webserver.cc:460] Webserver started at http://127.17.183.131:34023/ using document root <none> and password file <none>
I20260812 01:14:29.188587 31345 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:29.188702 31345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:29.190071 31345 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:29.190815 31370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:29.191027 31345 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:29.191118 31345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "662e0c240da3421691e37816883b1fdb"
format_stamp: "Formatted at 2026-08-12 01:14:28 on dist-test-slave-rwrg"
server_key: "a61e5c2fc7598ffd95df5d3d1a796419"
server_key_iv: "c2c5624a1b35405ed1cddb171d0612b7"
server_key_version: "encryptionkey@0"
I20260812 01:14:29.191486 31345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:29.213037 31345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:29.215147 31345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:29.215314 31345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:29.215564 31345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:29.215924 31345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:29.215994 31345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:29.216037 31345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:29.216061 31345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:29.222743 31345 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:36249
I20260812 01:14:29.222800 31569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:36249 every 8 connection(s)
I20260812 01:14:29.223142 31345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:29.224347 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 31345
Aug 12 01:14:29 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497269, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
Aug 12 01:14:29 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497269, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.188@KRBTEST.COM
Aug 12 01:14:29 dist-test-slave-rwrg krb5kdc[29260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497269, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.189@KRBTEST.COM
I20260812 01:14:29.233398 31594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.225598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48468 (local address 127.17.183.188:40543)
0812 01:14:29.225834 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.225836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.225842 (+ 6us) server_negotiation.cc:407] Connection header received
0812 01:14:29.225861 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.225862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.225872 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.225924 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.226771 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.227519 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.228584 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.228872 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.228926 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.230462 (+ 1536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.230463 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.230463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.230471 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.232111 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.232546 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.232547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.232548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.232610 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.232821 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.232827 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.232827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.232926 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.233051 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.233176 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.233269 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":42,"threads_started":1}
I20260812 01:14:29.236734 31096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.223893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:37303 (local address 127.17.183.188:40543)
0812 01:14:29.223944 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.223946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.224332 (+ 386us) server_negotiation.cc:407] Connection header received
0812 01:14:29.225116 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.225118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.225132 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.225189 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.226161 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.226927 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.229336 (+ 2409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.229639 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.229717 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.232334 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.232335 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.232335 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.232342 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.234929 (+ 2587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.235418 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.235419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.235420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.235475 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.235750 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.235751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.235751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.235878 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.235918 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.236363 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.236443 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 01:14:29.236765 31587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.223819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:40543 (local address 127.17.183.131:37303)
0812 01:14:29.224258 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.224269 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.225000 (+ 731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.225280 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.225284 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.225941 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:29.226050 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.226056 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.227062 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.227063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.229184 (+ 2121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.229186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.229770 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.229772 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.229863 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.230273 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:29.230278 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:29.232239 (+ 1961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:29.235019 (+ 2780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.235028 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.235030 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.235322 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.235547 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.235548 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.235548 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.235675 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.235966 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:29.235973 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:29.236150 (+ 177us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.236330 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.236483 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":1248,"thread_start_us":102,"threads_started":1}
I20260812 01:14:29.237434 30500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.224244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:56295 (local address 127.17.183.189:46001)
0812 01:14:29.224293 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.224296 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.224347 (+ 51us) server_negotiation.cc:407] Connection header received
0812 01:14:29.225133 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.225135 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.225147 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.225179 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.226160 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.226910 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.228530 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.228821 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.228883 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.234002 (+ 5119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.234004 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.234004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.234011 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.235599 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.236542 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.236543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.236544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.236610 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.236834 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.236835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.236835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.236961 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.237025 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.237222 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.237319 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 01:14:29.239238 31573 heartbeater.cc:347] Connected to a master server at 127.17.183.188:40543
I20260812 01:14:29.239328 31573 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:29.239485 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.223841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:41297 (local address 127.17.183.190:43571)
0812 01:14:29.223908 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.223911 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.225362 (+ 1451us) server_negotiation.cc:407] Connection header received
0812 01:14:29.225495 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.225497 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.225511 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.225546 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.226163 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.226911 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.228541 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.228847 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.228889 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.232787 (+ 3898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.232788 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.232789 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.232795 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.235560 (+ 2765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.236445 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.236446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.236446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.236534 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.238839 (+ 2305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.238840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.238841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.238988 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.239071 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.239284 (+ 213us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.239400 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 01:14:29.239517 31573 heartbeater.cc:511] Master 127.17.183.188:40543 requested a full tablet report, sending...
I20260812 01:14:29.239820 31579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.223819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.131:41297)
0812 01:14:29.224087 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.224131 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.225417 (+ 1286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.225622 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.225622 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.225899 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:29.226050 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.226056 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.227062 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.227063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.228414 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.228418 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.228974 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.228975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.229105 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.229756 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:29.229766 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:29.232694 (+ 2928us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:29.235650 (+ 2956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.235651 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.235651 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.235859 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.236827 (+ 968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.236828 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.236828 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.238749 (+ 1921us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.239104 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:29.239105 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:29.239148 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.239373 (+ 225us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.239475 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":227,"thread_start_us":102,"threads_started":1}
I20260812 01:14:29.239956 30762 ts_manager.cc:194] Registered new tserver with Master: 662e0c240da3421691e37816883b1fdb (127.17.183.131:36249)
I20260812 01:14:29.240186 31574 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43571
I20260812 01:14:29.240236 31574 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:29.240301 31574 heartbeater.cc:511] Master 127.17.183.190:43571 requested a full tablet report, sending...
I20260812 01:14:29.240550 29338 ts_manager.cc:194] Re-registered known tserver with Master: 662e0c240da3421691e37816883b1fdb (127.17.183.131:36249)
I20260812 01:14:29.237752 31582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.224137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:46001 (local address 127.17.183.131:56295)
0812 01:14:29.224286 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.224297 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.225007 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.225279 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.225284 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.225752 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:29.226050 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.226057 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.227099 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.227101 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.228415 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.228418 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.229924 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.229925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.230253 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.230651 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:29.230656 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:29.233904 (+ 3248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:29.235674 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.235675 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.235675 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.236347 (+ 672us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.236673 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:29.236674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:29.236674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:29.236759 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:29.237038 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:29.237039 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:29.237084 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.237507 (+ 423us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.237633 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":88,"thread_start_us":75,"threads_started":1}
I20260812 01:14:29.240918 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.227742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35100 (local address 127.17.183.189:46001)
0812 01:14:29.227946 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.227948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.233379 (+ 5431us) server_negotiation.cc:407] Connection header received
0812 01:14:29.233482 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.233483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.233498 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.233549 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.234252 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.235000 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.235985 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.236290 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.236331 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.237689 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.237691 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.237691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.237697 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.239461 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.239874 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.239876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.239876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.239940 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.240255 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.240256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.240257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.240395 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.240473 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.240719 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.240818 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":51,"threads_started":1}
I20260812 01:14:29.241079 29338 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:41297
I20260812 01:14:29.241096 31575 heartbeater.cc:347] Connected to a master server at 127.17.183.189:46001
I20260812 01:14:29.241138 31575 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:29.241199 31575 heartbeater.cc:511] Master 127.17.183.189:46001 requested a full tablet report, sending...
I20260812 01:14:29.241614 30406 ts_manager.cc:194] Registered new tserver with Master: 662e0c240da3421691e37816883b1fdb (127.17.183.131:36249)
I20260812 01:14:29.242107 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.227454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58628 (local address 127.17.183.190:43571)
0812 01:14:29.228187 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.228189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.228195 (+ 6us) server_negotiation.cc:407] Connection header received
0812 01:14:29.228215 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.228215 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.228225 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.231541 (+ 3316us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.231572 (+ 31us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.232219 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.234304 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.235807 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.236116 (+ 309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.237862 (+ 1746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.237864 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.237864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.237870 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.239879 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.240394 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.240395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.240395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.240453 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.241596 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.241597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.241598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.241735 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.241827 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.241948 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.242012 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":65,"threads_started":1}
I20260812 01:14:29.243474 29338 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58628:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:29.245106 29338 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:29.252620 31612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.248686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:37419 (local address 127.0.0.1:56078)
0812 01:14:29.249014 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.249025 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.249091 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.249452 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.249453 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.249490 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:29.249534 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.249535 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.250851 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.250852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.251695 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.251698 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.252348 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.252350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.252428 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.252433 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.252491 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.252548 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":51,"thread_start_us":214,"threads_started":1}
I20260812 01:14:29.252815 31616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.248813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56078 (local address 127.17.183.130:37419)
0812 01:14:29.249215 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.249220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.249229 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:29.249279 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.249281 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.249298 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.249402 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:29.249618 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.250759 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.251791 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.252262 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.252432 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.252559 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.252586 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.252631 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":88,"threads_started":1}
I20260812 01:14:29.253346 31617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.248765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:36249 (local address 127.0.0.1:56764)
0812 01:14:29.249716 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.249723 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.249780 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.249952 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.249953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.249955 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:29.250008 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.250009 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.250843 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.250844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.251950 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.251953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.252898 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.252899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.253159 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.253163 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.253230 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.253270 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":939,"thread_start_us":116,"threads_started":1}
I20260812 01:14:29.253464 31619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.248976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56764 (local address 127.17.183.131:36249)
0812 01:14:29.249125 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.249129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.249783 (+ 654us) server_negotiation.cc:407] Connection header received
0812 01:14:29.249844 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.249846 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.249861 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.249953 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:29.250061 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.250736 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.252036 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.252737 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.252821 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.252865 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.253268 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.253320 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
I20260812 01:14:29.253551 31209 tablet_service.cc:1467] Processing CreateTablet for tablet 5f1d7e88c15945b1b969e994973394f7 (DEFAULT_TABLE table=test-table [id=e026199a123c4aebb0561c67013a2337]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:29.253706 31613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.248724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45743 (local address 127.0.0.1:46494)
0812 01:14:29.249581 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.249591 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.249645 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.249898 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.249899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.249901 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:29.249940 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.249941 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.251380 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.251381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.252365 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.252368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.253367 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.253368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.253515 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.253518 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.253564 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.253646 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"mutex_wait_us":3,"thread_start_us":188,"threads_started":1}
I20260812 01:14:29.253933 31620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.249007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46494 (local address 127.17.183.129:45743)
0812 01:14:29.249532 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.249536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.249667 (+ 131us) server_negotiation.cc:407] Connection header received
0812 01:14:29.249719 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.249721 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.249738 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.249821 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:29.250016 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.251035 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.252449 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.253200 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.253277 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.253336 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.253820 (+ 484us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.253862 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":97,"threads_started":1}
I20260812 01:14:29.253959 31209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f1d7e88c15945b1b969e994973394f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:29.254536 30963 tablet_service.cc:1467] Processing CreateTablet for tablet 5f1d7e88c15945b1b969e994973394f7 (DEFAULT_TABLE table=test-table [id=e026199a123c4aebb0561c67013a2337]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:29.254858 30963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f1d7e88c15945b1b969e994973394f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:29.257035 31449 tablet_service.cc:1467] Processing CreateTablet for tablet 5f1d7e88c15945b1b969e994973394f7 (DEFAULT_TABLE table=test-table [id=e026199a123c4aebb0561c67013a2337]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:29.257339 31449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f1d7e88c15945b1b969e994973394f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:29.257575 31622 tablet_bootstrap.cc:492] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: Bootstrap starting.
I20260812 01:14:29.258237 31623 tablet_bootstrap.cc:492] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: Bootstrap starting.
I20260812 01:14:29.258401 31622 tablet_bootstrap.cc:654] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:29.258719 31622 log.cc:824] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:29.258797 31623 tablet_bootstrap.cc:654] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:29.259097 31623 log.cc:824] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:29.259697 31622 tablet_bootstrap.cc:492] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: No bootstrap required, opened a new log
I20260812 01:14:29.259765 31622 ts_tablet_manager.cc:1397] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:29.259822 31623 tablet_bootstrap.cc:492] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: No bootstrap required, opened a new log
I20260812 01:14:29.259867 31623 ts_tablet_manager.cc:1397] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:14:29.261792 31623 raft_consensus.cc:348] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:29.261936 31623 raft_consensus.cc:374] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:29.261981 31623 raft_consensus.cc:729] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2519cfbc421d4a77aaf37acbface3339, State: Initialized, Role: FOLLOWER
I20260812 01:14:29.262090 31623 consensus_queue.cc:260] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:29.262007 31622 raft_consensus.cc:348] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:29.262152 31622 raft_consensus.cc:374] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:29.262216 31622 raft_consensus.cc:729] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d29775d69234b4fa0c3ca59918ff40e, State: Initialized, Role: FOLLOWER
I20260812 01:14:29.262339 31623 ts_tablet_manager.cc:1428] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 01:14:29.262319 31622 consensus_queue.cc:260] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:29.262598 31087 heartbeater.cc:503] Master 127.17.183.190:43571 was elected leader, sending a full tablet report...
I20260812 01:14:29.262735 31622 ts_tablet_manager.cc:1428] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:14:29.262882 31334 heartbeater.cc:503] Master 127.17.183.190:43571 was elected leader, sending a full tablet report...
I20260812 01:14:29.263706 31629 tablet_bootstrap.cc:492] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb: Bootstrap starting.
I20260812 01:14:29.264415 31629 tablet_bootstrap.cc:654] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:29.264858 31629 log.cc:824] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:29.265601 31629 tablet_bootstrap.cc:492] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb: No bootstrap required, opened a new log
I20260812 01:14:29.265652 31629 ts_tablet_manager.cc:1397] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 01:14:29.267832 31629 raft_consensus.cc:348] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:29.267943 31629 raft_consensus.cc:374] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:29.267963 31629 raft_consensus.cc:729] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 662e0c240da3421691e37816883b1fdb, State: Initialized, Role: FOLLOWER
I20260812 01:14:29.268095 31629 consensus_queue.cc:260] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:29.268386 31629 ts_tablet_manager.cc:1428] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:14:29.268453 31574 heartbeater.cc:503] Master 127.17.183.190:43571 was elected leader, sending a full tablet report...
W20260812 01:14:29.305089 31338 tablet.cc:2369] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:14:29.331668 31096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.329335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48476 (local address 127.17.183.188:40543)
0812 01:14:29.329406 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.329407 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.329417 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:29.329444 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.329445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.329469 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.329528 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:29.329658 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.330146 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.330997 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.331397 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.331456 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.331507 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.331586 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.331616 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:14:29.331667 31613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.329238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:40543 (local address 127.0.0.1:48476)
0812 01:14:29.329324 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.329337 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.329399 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.329543 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.329544 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.329546 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:29.329595 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.329596 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.330207 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.330208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.330915 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.330917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.331470 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.331471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.331520 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.331524 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.331565 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.331605 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 01:14:29.332093 30775 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260812 01:14:29.333177 31637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ecb17584ae4e4e51a5aa7f580ec47253. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:29.333290 31637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: This master's current role is: LEARNER
I20260812 01:14:29.361596 31633 raft_consensus.cc:482] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:29.361704 31633 raft_consensus.cc:504] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:29.362012 31633 leader_election.cc:288] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d29775d69234b4fa0c3ca59918ff40e (127.17.183.130:37419), 662e0c240da3421691e37816883b1fdb (127.17.183.131:36249)
I20260812 01:14:29.365206 31616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.362275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:45003 (local address 127.17.183.130:37419)
0812 01:14:29.362322 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.362324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.362334 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:29.362366 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.362367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.362376 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.362444 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:29.362643 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.363366 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.364412 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.364835 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.364922 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.364932 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.365102 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.365144 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:14:29.365214 31619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.362277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:49449 (local address 127.17.183.131:36249)
0812 01:14:29.362322 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.362324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.362334 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:29.362366 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.362367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.362376 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.362444 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:29.362645 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.363379 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.364391 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.364821 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.364926 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.364936 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.365112 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.365156 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 01:14:29.365203 31097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.362206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:37419 (local address 127.17.183.129:45003)
0812 01:14:29.362252 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.362264 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.362304 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.362465 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.362466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.362468 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:29.362564 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.362565 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.363484 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.363486 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.364299 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.364302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.364921 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.364923 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.365004 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.365007 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.365073 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.365113 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":5}
I20260812 01:14:29.365206 31094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.362195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:36249 (local address 127.17.183.129:49449)
0812 01:14:29.362252 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:29.362264 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:29.362304 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:29.362465 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:29.362466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:29.362468 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:29.362564 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.362566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.363451 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.363452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.364297 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:29.364300 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.364927 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.364928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:29.365011 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.365022 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 01:14:29.365082 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 01:14:29.365123 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":90,"spinlock_wait_cycles":896}
I20260812 01:14:29.365589 31488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f1d7e88c15945b1b969e994973394f7" candidate_uuid: "2519cfbc421d4a77aaf37acbface3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "662e0c240da3421691e37816883b1fdb" is_pre_election: true
I20260812 01:14:29.365604 31246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f1d7e88c15945b1b969e994973394f7" candidate_uuid: "2519cfbc421d4a77aaf37acbface3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d29775d69234b4fa0c3ca59918ff40e" is_pre_election: true
I20260812 01:14:29.365769 31488 raft_consensus.cc:2454] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2519cfbc421d4a77aaf37acbface3339 in term 0.
I20260812 01:14:29.365763 31246 raft_consensus.cc:2454] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2519cfbc421d4a77aaf37acbface3339 in term 0.
I20260812 01:14:29.365996 30875 leader_election.cc:302] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d29775d69234b4fa0c3ca59918ff40e, 2519cfbc421d4a77aaf37acbface3339; no voters:
I20260812 01:14:29.366183 31633 raft_consensus.cc:2781] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:29.366245 31633 raft_consensus.cc:482] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:29.366271 31633 raft_consensus.cc:3037] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:29.367158 31633 raft_consensus.cc:504] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:29.367295 31633 leader_election.cc:288] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [CANDIDATE]: Term 1 election: Requested vote from peers 0d29775d69234b4fa0c3ca59918ff40e (127.17.183.130:37419), 662e0c240da3421691e37816883b1fdb (127.17.183.131:36249)
I20260812 01:14:29.367465 31488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f1d7e88c15945b1b969e994973394f7" candidate_uuid: "2519cfbc421d4a77aaf37acbface3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "662e0c240da3421691e37816883b1fdb"
I20260812 01:14:29.367444 31246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f1d7e88c15945b1b969e994973394f7" candidate_uuid: "2519cfbc421d4a77aaf37acbface3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d29775d69234b4fa0c3ca59918ff40e"
I20260812 01:14:29.367537 31488 raft_consensus.cc:3037] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:29.367537 31246 raft_consensus.cc:3037] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:29.368582 31488 raft_consensus.cc:2454] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2519cfbc421d4a77aaf37acbface3339 in term 1.
I20260812 01:14:29.368589 31246 raft_consensus.cc:2454] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2519cfbc421d4a77aaf37acbface3339 in term 1.
I20260812 01:14:29.368785 30869 leader_election.cc:302] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2519cfbc421d4a77aaf37acbface3339, 662e0c240da3421691e37816883b1fdb; no voters:
I20260812 01:14:29.368897 31633 raft_consensus.cc:2781] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:29.369009 31633 raft_consensus.cc:686] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 1 LEADER]: Becoming Leader. State: Replica: 2519cfbc421d4a77aaf37acbface3339, State: Running, Role: LEADER
I20260812 01:14:29.369220 31633 consensus_queue.cc:237] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:29.370065 29338 catalog_manager.cc:5495] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2519cfbc421d4a77aaf37acbface3339 (127.17.183.129). New cstate: current_term: 1 leader_uuid: "2519cfbc421d4a77aaf37acbface3339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } health_report { overall_health: HEALTHY } } }
I20260812 01:14:29.370870 31603 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: NON_VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: true } } }
I20260812 01:14:29.370985 31603 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:29.371796 31651 raft_consensus.cc:1050] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253: attempting to promote NON_VOTER 3a1986b4a35c4f75af2d22e0c7a5997c to VOTER
I20260812 01:14:29.371927 31651 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } }
I20260812 01:14:29.372452 30422 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 FOLLOWER]: Refusing update from remote peer ecb17584ae4e4e51a5aa7f580ec47253: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260812 01:14:29.372574 30775 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 LEARNER]: Refusing update from remote peer ecb17584ae4e4e51a5aa7f580ec47253: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260812 01:14:29.372743 31603 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 01:14:29.372830 31650 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 01:14:29.373482 31650 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 3a1986b4a35c4f75af2d22e0c7a5997c (127.17.183.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:29.373636 30422 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 3a1986b4a35c4f75af2d22e0c7a5997c (127.17.183.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:29.373632 30775 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 3a1986b4a35c4f75af2d22e0c7a5997c (127.17.183.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:29.374454 31650 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:29.374541 31650 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:29.374607 31650 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:29.374665 31650 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:29.374625 31637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:29.374724 31637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:14:29.374711 31650 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:29.374768 31650 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:29.374926 31653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:29.375057 31653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 01:14:29.381373 31092 tablet.cc:2369] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:14:29.396798 31620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.394243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46508 (local address 127.17.183.129:45743)
0812 01:14:29.394297 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.394299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.394307 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:29.394344 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.394344 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.394364 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.394443 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:29.394648 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.395233 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.395951 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.396171 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.396225 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.396395 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:29.396557 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:29.396625 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.396660 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.396678 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:14:29.398670 31488 raft_consensus.cc:1261] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb [term 1 FOLLOWER]: Refusing update from remote peer 2519cfbc421d4a77aaf37acbface3339: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:29.398710 31246 raft_consensus.cc:1261] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e [term 1 FOLLOWER]: Refusing update from remote peer 2519cfbc421d4a77aaf37acbface3339: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:29.399022 31633 consensus_queue.cc:1035] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:29.399247 31646 consensus_queue.cc:1035] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:29.403177 31666 mvcc.cc:205] Tried to move back new op lower bound from 7317492815454117888 to 7317492815337140224. Current Snapshot: MvccSnapshot[applied={T|T < 7317492815454117888}]
I20260812 01:14:29.403918 31661 mvcc.cc:205] Tried to move back new op lower bound from 7317492815454117888 to 7317492815337140224. Current Snapshot: MvccSnapshot[applied={T|T < 7317492815454117888}]
I20260812 01:14:29.404081 31660 mvcc.cc:205] Tried to move back new op lower bound from 7317492815454117888 to 7317492815337140224. Current Snapshot: MvccSnapshot[applied={T|T < 7317492815454117888}]
I20260812 01:14:29.406739 29338 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:29.406844 29338 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:29.408267 29338 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ecb17584ae4e4e51a5aa7f580ec47253: Sending DeleteTablet for 3 replicas of tablet 5f1d7e88c15945b1b969e994973394f7
I20260812 01:14:29.408667 31209 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f1d7e88c15945b1b969e994973394f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:29 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:56078
I20260812 01:14:29.408754 31449 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f1d7e88c15945b1b969e994973394f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:29 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:56764
I20260812 01:14:29.408838 30963 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f1d7e88c15945b1b969e994973394f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:29 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:46494
I20260812 01:14:29.409085 31681 tablet_replica.cc:330] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb: stopping tablet replica
I20260812 01:14:29.409106 31683 tablet_replica.cc:330] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: stopping tablet replica
I20260812 01:14:29.409190 31681 raft_consensus.cc:2229] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:29.409196 31683 raft_consensus.cc:2229] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:29.409314 31681 raft_consensus.cc:2258] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:29.409366 31683 raft_consensus.cc:2258] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:29.409801 31681 ts_tablet_manager.cc:1905] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:29.409898 31683 ts_tablet_manager.cc:1905] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:29.411275 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 29277
I20260812 01:14:29.411793 31683 ts_tablet_manager.cc:1918] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:29.411872 31683 log.cc:1196] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/5f1d7e88c15945b1b969e994973394f7
I20260812 01:14:29.412171 31683 ts_tablet_manager.cc:1939] T 5f1d7e88c15945b1b969e994973394f7 P 2519cfbc421d4a77aaf37acbface3339: Deleting consensus metadata
I20260812 01:14:29.414635 31681 ts_tablet_manager.cc:1918] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:29.414696 31681 log.cc:1196] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/5f1d7e88c15945b1b969e994973394f7
I20260812 01:14:29.414907 31681 ts_tablet_manager.cc:1939] T 5f1d7e88c15945b1b969e994973394f7 P 662e0c240da3421691e37816883b1fdb: Deleting consensus metadata
I20260812 01:14:29.419878 31679 tablet_replica.cc:330] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: stopping tablet replica
I20260812 01:14:29.420050 31679 raft_consensus.cc:2229] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:29.420241 31679 raft_consensus.cc:2258] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:29.421236 31679 ts_tablet_manager.cc:1905] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:29.423055 31679 ts_tablet_manager.cc:1918] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:29.423213 31679 log.cc:1196] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/5f1d7e88c15945b1b969e994973394f7
I20260812 01:14:29.423527 31679 ts_tablet_manager.cc:1939] T 5f1d7e88c15945b1b969e994973394f7 P 0d29775d69234b4fa0c3ca59918ff40e: Deleting consensus metadata
I20260812 01:14:29.428325 31096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.410891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48484 (local address 127.17.183.188:40543)
0812 01:14:29.410939 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.410942 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.419729 (+ 8787us) server_negotiation.cc:407] Connection header received
0812 01:14:29.419798 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.419799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.419814 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.419878 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.420895 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.421627 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.422803 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.423118 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.423163 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.424811 (+ 1648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.424813 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.424813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.424820 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.426772 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.427258 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.427259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.427260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.427324 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.427639 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.427640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.427640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.427810 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.427914 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.428119 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.428219 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 01:14:29.431200 30868 connection.cc:535] server connection from 127.0.0.1:46494 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:14:29.431224 31372 connection.cc:535] server connection from 127.0.0.1:56764 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:14:29.431613 31131 connection.cc:535] server connection from 127.0.0.1:56078 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 01:14:29.440585 31096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.433247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48496 (local address 127.17.183.188:40543)
0812 01:14:29.433288 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.433290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.433425 (+ 135us) server_negotiation.cc:407] Connection header received
0812 01:14:29.433536 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.433537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.433548 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.433597 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.434420 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.434889 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.435651 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.435852 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.435941 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.437656 (+ 1715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.437657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.437657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.437663 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.439257 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.439691 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.439692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.439692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.439763 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.439992 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.439993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.439993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.440124 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.440239 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.440367 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.440448 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:14:29.441602 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:29.433509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35106 (local address 127.17.183.189:46001)
0812 01:14:29.433552 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:29.433554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:29.433562 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:29.433584 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:29.433585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:29.433597 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:29.433672 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:29.434814 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.435553 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.436780 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:29.437097 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:29.437183 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:29.438452 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:29.438453 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:29.438453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:29.438461 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:29.440137 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.440694 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.440696 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.440696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.440769 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:29.441016 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:29.441017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:29.441017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:29.441160 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:29.441221 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:29.441413 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 01:14:29.441497 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 01:14:30.404452 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.404096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.131:41233)
0812 01:14:30.404289 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.404393 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":67,"threads_started":1}
I20260812 01:14:30.404731 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.404093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.130:48153)
0812 01:14:30.404604 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.404682 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":70,"threads_started":1}
W20260812 01:14:30.404917 31574 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:43571 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
W20260812 01:14:30.404955 31334 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:43571 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
I20260812 01:14:30.405818 31702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.405570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.129:58179)
0812 01:14:30.405705 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.405784 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
W20260812 01:14:30.406038 31087 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:43571 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
I20260812 01:14:30.909276 31703 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecb17584ae4e4e51a5aa7f580ec47253)
I20260812 01:14:30.909466 31703 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } }
I20260812 01:14:30.909822 31703 leader_election.cc:288] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecb17584ae4e4e51a5aa7f580ec47253 (127.17.183.190:43571), 3a1986b4a35c4f75af2d22e0c7a5997c (127.17.183.188:40543)
I20260812 01:14:30.910211 31704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.909983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:59092)
0812 01:14:30.910103 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.910161 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":53,"threads_started":1}
W20260812 01:14:30.910364 30388 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
I20260812 01:14:30.910406 31711 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecb17584ae4e4e51a5aa7f580ec47253)
I20260812 01:14:30.910585 31711 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } }
I20260812 01:14:30.910858 31711 leader_election.cc:288] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecb17584ae4e4e51a5aa7f580ec47253 (127.17.183.190:43571), 9b1299fc1e6f47d285cc5b22def02bc7 (127.17.183.189:46001)
I20260812 01:14:30.910903 31704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.910782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:59106)
0812 01:14:30.910817 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.910869 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260812 01:14:30.911000 30388 leader_election.cc:334] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ecb17584ae4e4e51a5aa7f580ec47253 (127.17.183.190:43571): Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
I20260812 01:14:30.911208 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.910955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:59108)
0812 01:14:30.911118 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.911176 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":60,"threads_started":1}
W20260812 01:14:30.911334 30731 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
I20260812 01:14:30.911792 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.911660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:59110)
0812 01:14:30.911718 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.911759 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 01:14:30.911901 30731 leader_election.cc:334] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ecb17584ae4e4e51a5aa7f580ec47253 (127.17.183.190:43571): Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
I20260812 01:14:30.913698 31708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.910169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48512 (local address 127.17.183.188:40543)
0812 01:14:30.910357 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:30.910359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:30.910369 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:30.910403 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:30.910403 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:30.910435 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:30.910691 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:30.910734 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.911498 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.912935 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.913348 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.913430 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:30.913439 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:30.913598 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 01:14:30.913639 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260812 01:14:30.913699 31705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.910003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:40543 (local address 127.0.0.1:48512)
0812 01:14:30.910192 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.910202 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:30.910288 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:30.910537 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:30.910538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:30.910541 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:30.910614 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:30.910616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.911596 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.911597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:30.912867 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:30.912869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.913428 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.913429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:30.913494 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:30.913498 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:30.913589 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 01:14:30.913632 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":38,"threads_started":1}
I20260812 01:14:30.914008 30775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" is_pre_election: true
I20260812 01:14:30.914116 30775 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1299fc1e6f47d285cc5b22def02bc7 in term 1.
I20260812 01:14:30.914286 30386 leader_election.cc:302] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a1986b4a35c4f75af2d22e0c7a5997c, 9b1299fc1e6f47d285cc5b22def02bc7; no voters: ecb17584ae4e4e51a5aa7f580ec47253
I20260812 01:14:30.914438 31703 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 01:14:30.914582 31703 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecb17584ae4e4e51a5aa7f580ec47253)
I20260812 01:14:30.914601 31703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:14:30.914899 31715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.911108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:46001 (local address 127.0.0.1:35110)
0812 01:14:30.911523 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.911535 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:30.911730 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:30.911935 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:30.911936 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:30.911939 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:30.911989 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:30.911990 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.912866 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.912867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:30.913632 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:30.913634 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.914620 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.914622 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:30.914691 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:30.914694 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:30.914786 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 01:14:30.914831 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":44,"threads_started":1}
I20260812 01:14:30.914906 31718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.911250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35110 (local address 127.17.183.189:46001)
0812 01:14:30.911408 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:30.911410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:30.911617 (+ 207us) server_negotiation.cc:407] Connection header received
0812 01:14:30.911811 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:30.911812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:30.911822 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:30.911890 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:30.912090 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.912794 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.913747 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.914452 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.914561 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:30.914569 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:30.914794 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 01:14:30.914835 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":94,"threads_started":1}
I20260812 01:14:30.915161 30422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" is_pre_election: true
I20260812 01:14:30.915566 31703 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } }
I20260812 01:14:30.915725 30422 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a1986b4a35c4f75af2d22e0c7a5997c in current term 2: Already voted for candidate 9b1299fc1e6f47d285cc5b22def02bc7 in this term.
I20260812 01:14:30.915729 31703 leader_election.cc:288] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [CANDIDATE]: Term 2 election: Requested vote from peers ecb17584ae4e4e51a5aa7f580ec47253 (127.17.183.190:43571), 3a1986b4a35c4f75af2d22e0c7a5997c (127.17.183.188:40543)
I20260812 01:14:30.915879 30775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c"
I20260812 01:14:30.915942 30775 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:14:30.915947 30731 leader_election.cc:302] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a1986b4a35c4f75af2d22e0c7a5997c; no voters: 9b1299fc1e6f47d285cc5b22def02bc7, ecb17584ae4e4e51a5aa7f580ec47253
I20260812 01:14:30.916020 31705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.915821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:59126)
0812 01:14:30.915967 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.915995 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260812 01:14:30.916393 31705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.916320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:59142)
0812 01:14:30.916352 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.916377 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260812 01:14:30.916473 30388 leader_election.cc:334] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ecb17584ae4e4e51a5aa7f580ec47253 (127.17.183.190:43571): Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
I20260812 01:14:30.916819 30775 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1299fc1e6f47d285cc5b22def02bc7 in term 2.
I20260812 01:14:30.916920 31711 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:14:30.916996 30386 leader_election.cc:302] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a1986b4a35c4f75af2d22e0c7a5997c, 9b1299fc1e6f47d285cc5b22def02bc7; no voters: ecb17584ae4e4e51a5aa7f580ec47253
I20260812 01:14:30.917078 31703 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 01:14:30.917229 31703 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [term 2 LEADER]: Becoming Leader. State: Replica: 9b1299fc1e6f47d285cc5b22def02bc7, State: Running, Role: LEADER
I20260812 01:14:30.917301 31703 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } }
I20260812 01:14:30.917649 31724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b1299fc1e6f47d285cc5b22def02bc7. Latest consensus state: current_term: 2 leader_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:30.917726 31724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:30.917891 31729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:30.918382 31729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:30.918494 31729 catalog_manager.cc:1259] Loaded cluster ID: b72805d0b192477988222afaeee3b72c
I20260812 01:14:30.918531 31729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:30.918726 31729 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:30.918828 31729 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: Loaded TSK: 0
I20260812 01:14:30.918973 31729 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:14:30.978000 30404 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:30.979676 30404 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:30.980870 31705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.980700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:59170)
0812 01:14:30.980758 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.980816 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 01:14:30.980990 30775 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [term 2 FOLLOWER]: Refusing update from remote peer 9b1299fc1e6f47d285cc5b22def02bc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 01:14:30.981276 31705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.981155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.0.0.1:59174)
0812 01:14:30.981215 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.981247 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 01:14:30.981269 31724 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260812 01:14:30.981423 30388 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 -> Peer ecb17584ae4e4e51a5aa7f580ec47253 (127.17.183.190:43571): Couldn't send request to peer ecb17584ae4e4e51a5aa7f580ec47253. Status: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 01:14:30.981937 31711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b1299fc1e6f47d285cc5b22def02bc7. Latest consensus state: current_term: 2 leader_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:30.982084 31711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:14:30.982522 31703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:30.982613 31703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:30.982738 31711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "ecb17584ae4e4e51a5aa7f580ec47253" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43571 } } peers { permanent_uuid: "9b1299fc1e6f47d285cc5b22def02bc7" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 46001 } attrs { promote: false } } peers { permanent_uuid: "3a1986b4a35c4f75af2d22e0c7a5997c" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 40543 } attrs { promote: false } } }
I20260812 01:14:30.982821 31711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1986b4a35c4f75af2d22e0c7a5997c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:14:30.987661 31705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.984421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:37419 (local address 127.0.0.1:56080)
0812 01:14:30.984544 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.984556 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:30.984597 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:30.984956 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:30.984957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:30.984959 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:30.985025 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:30.985027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.986030 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.986031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:30.986724 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:30.986726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.987439 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.987440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:30.987501 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:30.987506 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:14:30.987561 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 01:14:30.987596 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260812 01:14:30.987695 31743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.984542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56080 (local address 127.17.183.130:37419)
0812 01:14:30.984816 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:30.984818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:30.984827 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:30.984855 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:30.984856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:30.984866 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:30.985108 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:30.985150 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.985927 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.986805 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.987360 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.987432 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:30.987441 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:30.987587 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 01:14:30.987625 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":74,"threads_started":1}
I20260812 01:14:30.988149 31209 tablet_service.cc:1467] Processing CreateTablet for tablet d61028721aea44738d125b47b54a6835 (DEFAULT_TABLE table=test-table [id=aa71ea77d1e94cb2a58463cb5c21fc39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:30.988188 31704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.984421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:36249 (local address 127.0.0.1:56768)
0812 01:14:30.984607 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.984619 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:30.984670 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:30.984972 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:30.984974 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:30.984975 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:30.985145 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:30.985146 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.986015 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.986016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:30.987131 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:30.987134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.987934 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.987935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:30.988001 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:30.988004 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:30.988063 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 01:14:30.988109 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":202}
I20260812 01:14:30.988217 31744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.984472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45743 (local address 127.0.0.1:46524)
0812 01:14:30.984674 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.984685 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:30.984727 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:30.984929 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:30.984930 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:30.984933 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:30.984994 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:30.984996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.985844 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.985845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:30.987225 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:30.987228 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.988002 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.988002 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:30.988059 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:30.988063 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:30.988107 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 01:14:30.988136 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":53,"thread_start_us":158,"threads_started":1}
I20260812 01:14:30.988327 31209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61028721aea44738d125b47b54a6835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:30.988456 31745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.984688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46524 (local address 127.17.183.129:45743)
0812 01:14:30.984800 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:30.984802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:30.984809 (+ 7us) server_negotiation.cc:407] Connection header received
0812 01:14:30.984833 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:30.984833 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:30.984842 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:30.984914 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:30.985072 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.985657 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.987290 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.987878 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.987965 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:30.987974 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:30.988343 (+ 369us) server_negotiation.cc:299] Negotiation successful
0812 01:14:30.988389 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":67,"threads_started":1}
I20260812 01:14:30.988463 31740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.984512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56768 (local address 127.17.183.131:36249)
0812 01:14:30.984827 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:30.984830 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:30.984839 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:30.984863 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:30.984864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:30.984877 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:30.985024 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:30.985204 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.985926 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.987224 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:30.987848 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:30.987920 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:30.987927 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:30.988352 (+ 425us) server_negotiation.cc:299] Negotiation successful
0812 01:14:30.988396 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":54,"threads_started":1}
I20260812 01:14:30.989643 31746 tablet_bootstrap.cc:492] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e: Bootstrap starting.
I20260812 01:14:30.989794 30963 tablet_service.cc:1467] Processing CreateTablet for tablet d61028721aea44738d125b47b54a6835 (DEFAULT_TABLE table=test-table [id=aa71ea77d1e94cb2a58463cb5c21fc39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:30.989938 30963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61028721aea44738d125b47b54a6835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:30.990089 31746 tablet_bootstrap.cc:654] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:30.990808 31746 tablet_bootstrap.cc:492] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e: No bootstrap required, opened a new log
I20260812 01:14:30.990854 31746 ts_tablet_manager.cc:1397] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:30.990995 31746 raft_consensus.cc:348] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:30.991061 31746 raft_consensus.cc:374] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:30.991075 31746 raft_consensus.cc:729] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d29775d69234b4fa0c3ca59918ff40e, State: Initialized, Role: FOLLOWER
I20260812 01:14:30.991115 31746 consensus_queue.cc:260] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:30.991269 31746 ts_tablet_manager.cc:1428] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:30.991530 31449 tablet_service.cc:1467] Processing CreateTablet for tablet d61028721aea44738d125b47b54a6835 (DEFAULT_TABLE table=test-table [id=aa71ea77d1e94cb2a58463cb5c21fc39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:30.991667 31449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61028721aea44738d125b47b54a6835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:30.991648 31753 tablet_bootstrap.cc:492] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339: Bootstrap starting.
I20260812 01:14:30.992085 31753 tablet_bootstrap.cc:654] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:30.992848 31755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.991557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.130:46063)
0812 01:14:30.992776 (+ 1219us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.992815 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1194,"thread_start_us":84,"threads_started":1}
I20260812 01:14:30.992856 31753 tablet_bootstrap.cc:492] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339: No bootstrap required, opened a new log
I20260812 01:14:30.992959 31753 ts_tablet_manager.cc:1397] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:30.993083 31753 raft_consensus.cc:348] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:30.993148 31753 raft_consensus.cc:374] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:30.993163 31753 raft_consensus.cc:729] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2519cfbc421d4a77aaf37acbface3339, State: Initialized, Role: FOLLOWER
I20260812 01:14:30.993216 31753 consensus_queue.cc:260] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:30.993299 31760 tablet_bootstrap.cc:492] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb: Bootstrap starting.
I20260812 01:14:30.993376 31753 ts_tablet_manager.cc:1428] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:30.993696 31760 tablet_bootstrap.cc:654] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:30.994179 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.993684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.129:41431)
0812 01:14:30.994106 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.994142 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":85,"threads_started":1}
I20260812 01:14:30.994199 31088 heartbeater.cc:503] Master 127.17.183.189:46001 was elected leader, sending a full tablet report...
I20260812 01:14:30.994779 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.994463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.129:48547)
0812 01:14:30.994686 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.994748 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203}
I20260812 01:14:30.994839 31760 tablet_bootstrap.cc:492] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb: No bootstrap required, opened a new log
I20260812 01:14:30.994885 31760 ts_tablet_manager.cc:1397] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:14:30.995008 31760 raft_consensus.cc:348] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:30.995085 31760 raft_consensus.cc:374] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:30.995116 31760 raft_consensus.cc:729] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 662e0c240da3421691e37816883b1fdb, State: Initialized, Role: FOLLOWER
I20260812 01:14:30.995196 31760 consensus_queue.cc:260] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:30.995369 31760 ts_tablet_manager.cc:1428] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:30.995810 31770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.995582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.131:42689)
0812 01:14:30.995728 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.995774 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":82,"threads_started":1}
I20260812 01:14:30.996302 31575 heartbeater.cc:503] Master 127.17.183.189:46001 was elected leader, sending a full tablet report...
I20260812 01:14:30.996372 31770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:30.996200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.131:46419)
0812 01:14:30.996264 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:30.996292 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 01:14:31.017588 31761 raft_consensus.cc:482] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:31.017678 31761 raft_consensus.cc:504] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:31.017928 31761 leader_election.cc:288] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d29775d69234b4fa0c3ca59918ff40e (127.17.183.130:37419), 662e0c240da3421691e37816883b1fdb (127.17.183.131:36249)
I20260812 01:14:31.018154 31488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61028721aea44738d125b47b54a6835" candidate_uuid: "2519cfbc421d4a77aaf37acbface3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "662e0c240da3421691e37816883b1fdb" is_pre_election: true
I20260812 01:14:31.018168 31246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61028721aea44738d125b47b54a6835" candidate_uuid: "2519cfbc421d4a77aaf37acbface3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d29775d69234b4fa0c3ca59918ff40e" is_pre_election: true
I20260812 01:14:31.018258 31246 raft_consensus.cc:2454] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2519cfbc421d4a77aaf37acbface3339 in term 0.
I20260812 01:14:31.018258 31488 raft_consensus.cc:2454] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2519cfbc421d4a77aaf37acbface3339 in term 0.
I20260812 01:14:31.018435 30875 leader_election.cc:302] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d29775d69234b4fa0c3ca59918ff40e, 2519cfbc421d4a77aaf37acbface3339; no voters:
I20260812 01:14:31.018561 31761 raft_consensus.cc:2781] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:31.018648 31761 raft_consensus.cc:482] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:31.018687 31761 raft_consensus.cc:3037] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:31.019482 31761 raft_consensus.cc:504] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:31.019660 31761 leader_election.cc:288] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [CANDIDATE]: Term 1 election: Requested vote from peers 0d29775d69234b4fa0c3ca59918ff40e (127.17.183.130:37419), 662e0c240da3421691e37816883b1fdb (127.17.183.131:36249)
I20260812 01:14:31.019835 31488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61028721aea44738d125b47b54a6835" candidate_uuid: "2519cfbc421d4a77aaf37acbface3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "662e0c240da3421691e37816883b1fdb"
I20260812 01:14:31.019949 31488 raft_consensus.cc:3037] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:31.019915 31246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61028721aea44738d125b47b54a6835" candidate_uuid: "2519cfbc421d4a77aaf37acbface3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d29775d69234b4fa0c3ca59918ff40e"
I20260812 01:14:31.020002 31246 raft_consensus.cc:3037] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:31.020758 31246 raft_consensus.cc:2454] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2519cfbc421d4a77aaf37acbface3339 in term 1.
I20260812 01:14:31.020756 31488 raft_consensus.cc:2454] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2519cfbc421d4a77aaf37acbface3339 in term 1.
I20260812 01:14:31.020965 30875 leader_election.cc:302] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d29775d69234b4fa0c3ca59918ff40e, 2519cfbc421d4a77aaf37acbface3339; no voters:
I20260812 01:14:31.021083 31761 raft_consensus.cc:2781] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:31.021281 31761 raft_consensus.cc:686] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [term 1 LEADER]: Becoming Leader. State: Replica: 2519cfbc421d4a77aaf37acbface3339, State: Running, Role: LEADER
I20260812 01:14:31.021337 31761 consensus_queue.cc:237] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } }
I20260812 01:14:31.021692 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:31.021574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.129:35669)
0812 01:14:31.021620 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:31.021658 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 01:14:31.022042 30404 catalog_manager.cc:5495] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2519cfbc421d4a77aaf37acbface3339 (127.17.183.129). New cstate: current_term: 1 leader_uuid: "2519cfbc421d4a77aaf37acbface3339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2519cfbc421d4a77aaf37acbface3339" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45743 } health_report { overall_health: HEALTHY } } }
I20260812 01:14:31.033820 31745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:31.031651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46538 (local address 127.17.183.129:45743)
0812 01:14:31.031734 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:31.031736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:31.031746 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:31.031774 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:31.031774 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:31.031783 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:31.031831 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:31.031972 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:31.032474 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:31.033274 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:31.033460 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:31.033513 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:31.033629 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:31.033657 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:31.033695 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:31.033744 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 01:14:31.033763 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 01:14:31.034749 31246 raft_consensus.cc:1261] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e [term 1 FOLLOWER]: Refusing update from remote peer 2519cfbc421d4a77aaf37acbface3339: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:31.034757 31488 raft_consensus.cc:1261] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb [term 1 FOLLOWER]: Refusing update from remote peer 2519cfbc421d4a77aaf37acbface3339: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:31.034994 31761 consensus_queue.cc:1035] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d29775d69234b4fa0c3ca59918ff40e" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:31.035104 31771 consensus_queue.cc:1035] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "662e0c240da3421691e37816883b1fdb" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:31.035614 31336 heartbeater.cc:503] Master 127.17.183.189:46001 was elected leader, sending a full tablet report...
I20260812 01:14:31.036059 31755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:31.035936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.130:39491)
0812 01:14:31.035973 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:31.036027 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 01:14:31.036293 31770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:31.036170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.131:44997)
0812 01:14:31.036213 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:31.036257 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260812 01:14:31.037627 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:31.037524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.129:56007)
0812 01:14:31.037562 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:31.037594 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 01:14:31.038038 31755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:31.037932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.130:33451)
0812 01:14:31.037973 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:31.038004 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 01:14:31.038058 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:31.037947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.129:42599)
0812 01:14:31.037990 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:31.038017 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260812 01:14:31.039199 31770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:31.038086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43571 (local address 127.17.183.131:47301)
0812 01:14:31.039141 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:31.039172 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1040}
I20260812 01:14:31.039230 30404 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:31.039327 30404 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:31.040583 30404 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9b1299fc1e6f47d285cc5b22def02bc7: Sending DeleteTablet for 3 replicas of tablet d61028721aea44738d125b47b54a6835
I20260812 01:14:31.040860 31209 tablet_service.cc:1514] Processing DeleteTablet for tablet d61028721aea44738d125b47b54a6835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:31 UTC) from {username='oryx', principal='oryx/127.17.183.189@KRBTEST.COM'} at 127.0.0.1:56080
I20260812 01:14:31.040908 31449 tablet_service.cc:1514] Processing DeleteTablet for tablet d61028721aea44738d125b47b54a6835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:31 UTC) from {username='oryx', principal='oryx/127.17.183.189@KRBTEST.COM'} at 127.0.0.1:56768
I20260812 01:14:31.041059 31798 tablet_replica.cc:330] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e: stopping tablet replica
I20260812 01:14:31.041106 31799 tablet_replica.cc:330] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb: stopping tablet replica
I20260812 01:14:31.041095 30963 tablet_service.cc:1514] Processing DeleteTablet for tablet d61028721aea44738d125b47b54a6835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:31 UTC) from {username='oryx', principal='oryx/127.17.183.189@KRBTEST.COM'} at 127.0.0.1:46524
I20260812 01:14:31.041163 31799 raft_consensus.cc:2229] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:31.041224 31799 raft_consensus.cc:2258] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:31.041245 31798 raft_consensus.cc:2229] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:31.041261 31800 tablet_replica.cc:330] T d61028721aea44738d125b47b54a6835 P 2519cfbc421d4a77aaf37acbface3339: stopping tablet replica
I20260812 01:14:31.041365 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 30668
I20260812 01:14:31.041445 31798 raft_consensus.cc:2258] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:31.041508 31799 ts_tablet_manager.cc:1905] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:31.045768 31799 ts_tablet_manager.cc:1918] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:31.045821 31799 log.cc:1196] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/d61028721aea44738d125b47b54a6835
I20260812 01:14:31.046007 31799 ts_tablet_manager.cc:1939] T d61028721aea44738d125b47b54a6835 P 662e0c240da3421691e37816883b1fdb: Deleting consensus metadata
I20260812 01:14:31.046300 30389 catalog_manager.cc:4841] TS 662e0c240da3421691e37816883b1fdb (127.17.183.131:36249): tablet d61028721aea44738d125b47b54a6835 (table test-table [id=aa71ea77d1e94cb2a58463cb5c21fc39]) successfully deleted
I20260812 01:14:31.062577 31798 ts_tablet_manager.cc:1905] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:31.064370 31798 ts_tablet_manager.cc:1918] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:31.064431 31798 log.cc:1196] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/d61028721aea44738d125b47b54a6835
I20260812 01:14:31.064755 31798 ts_tablet_manager.cc:1939] T d61028721aea44738d125b47b54a6835 P 0d29775d69234b4fa0c3ca59918ff40e: Deleting consensus metadata
I20260812 01:14:31.065169 30390 catalog_manager.cc:4841] TS 0d29775d69234b4fa0c3ca59918ff40e (127.17.183.130:37419): tablet d61028721aea44738d125b47b54a6835 (table test-table [id=aa71ea77d1e94cb2a58463cb5c21fc39]) successfully deleted
I20260812 01:14:31.069514 31744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:31.069346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45743 (local address 127.0.0.1:46552)
0812 01:14:31.069418 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:31.069471 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:45743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 01:14:31.069595 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 31100
W20260812 01:14:31.069737 30386 catalog_manager.cc:4584] TS 2519cfbc421d4a77aaf37acbface3339 (127.17.183.129:45743): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d61028721aea44738d125b47b54a6835: Network error: Client connection negotiation failed: client connection to 127.17.183.129:45743: connect: Connection refused (error 111)
I20260812 01:14:31.083976 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 31345
I20260812 01:14:31.099237 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 30165
I20260812 01:14:31.118599 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 30507
2026-08-12T01:14:31Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5116 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:31 dist-test-slave-rwrg krb5kdc[31803](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:31 dist-test-slave-rwrg krb5kdc[31803](info): set up 2 sockets
Aug 12 01:14:31 dist-test-slave-rwrg krb5kdc[31803](info): commencing operation
krb5kdc: starting...
W20260812 01:14:32.446928 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.298s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:32 dist-test-slave-rwrg krb5kdc[31803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:32Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.190.keytab.
Entry for principal oryx/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.190.keytab.
I20260812 01:14:32.567063 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33825
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.190.keytab
--principal=oryx/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:33825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:32.649173 31826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:32.649433 31826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:32.649456 31826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:32.650553 31826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:32.650588 31826 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 01:14:32.650602 31826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:32.650615 31826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:32.650627 31826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:32.650640 31826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:32.652098 31826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:33825
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.190.keytab
--principal=oryx/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:32.652305 31826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:32.652495 31826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:32.657475 31836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:32.657455 31840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:32.657528 31826 server_base.cc:1034] running on GCE node
W20260812 01:14:32.657459 31838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:32.657953 31826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:32.658206 31826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:32.659380 31826 hybrid_clock.cc:648] HybridClock initialized: now 1786497272659372 us; error 32 us; skew 500 ppm
Aug 12 01:14:32 dist-test-slave-rwrg krb5kdc[31803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497272, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:32.661919 31826 init.cc:377] Logged in from keytab as oryx/127.17.183.190@KRBTEST.COM (short username oryx)
I20260812 01:14:32.662402 31826 webserver.cc:460] Webserver started at http://127.17.183.190:39211/ using document root <none> and password file <none>
I20260812 01:14:32.662626 31826 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:32.662689 31826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:32.662843 31826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:32.663900 31826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "1f7afeaee50d458c980aee6ef650f016"
format_stamp: "Formatted at 2026-08-12 01:14:32 on dist-test-slave-rwrg"
server_key: "4cd8207cd5847675a5bcbb8b29c37894"
server_key_iv: "f8da1e14cd821466fe5aab398b90edda"
server_key_version: "encryptionkey@0"
I20260812 01:14:32.664283 31826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "1f7afeaee50d458c980aee6ef650f016"
format_stamp: "Formatted at 2026-08-12 01:14:32 on dist-test-slave-rwrg"
server_key: "4cd8207cd5847675a5bcbb8b29c37894"
server_key_iv: "f8da1e14cd821466fe5aab398b90edda"
server_key_version: "encryptionkey@0"
I20260812 01:14:32.665781 31826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:32.666615 31852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:32.666798 31826 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:32.666906 31826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "1f7afeaee50d458c980aee6ef650f016"
format_stamp: "Formatted at 2026-08-12 01:14:32 on dist-test-slave-rwrg"
server_key: "4cd8207cd5847675a5bcbb8b29c37894"
server_key_iv: "f8da1e14cd821466fe5aab398b90edda"
server_key_version: "encryptionkey@0"
I20260812 01:14:32.666980 31826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:32.682312 31826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:32.684106 31826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:32.684273 31826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:32.689440 31826 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:33825
I20260812 01:14:32.689533 31964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:33825 every 8 connection(s)
I20260812 01:14:32.689868 31826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:32.690573 31965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:32.691711 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 31826
I20260812 01:14:32.691840 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:32.692065 18142 external_mini_cluster.cc:1428] Setting key 66f20a56ffae5c5f8f9691a103e952be
I20260812 01:14:32.693957 31965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016: Bootstrap starting.
I20260812 01:14:32.694705 31965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:32.695075 31965 log.cc:824] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:32.695889 31965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016: No bootstrap required, opened a new log
I20260812 01:14:32.698388 31965 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f7afeaee50d458c980aee6ef650f016" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33825 } }
I20260812 01:14:32.698547 31965 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:32.698575 31965 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7afeaee50d458c980aee6ef650f016, State: Initialized, Role: FOLLOWER
I20260812 01:14:32.698734 31965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f7afeaee50d458c980aee6ef650f016" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33825 } }
I20260812 01:14:32.698823 31965 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:32.698872 31965 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:32.698927 31965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 01:14:32 dist-test-slave-rwrg krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:32.699667 31965 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f7afeaee50d458c980aee6ef650f016" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33825 } }
I20260812 01:14:32.699785 31965 leader_election.cc:302] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f7afeaee50d458c980aee6ef650f016; no voters:
I20260812 01:14:32.699990 31965 leader_election.cc:288] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:32.700030 31971 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:32.700237 31971 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7afeaee50d458c980aee6ef650f016, State: Running, Role: LEADER
I20260812 01:14:32.700392 31971 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f7afeaee50d458c980aee6ef650f016" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33825 } }
I20260812 01:14:32.700399 31965 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:32.700870 31973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f7afeaee50d458c980aee6ef650f016" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f7afeaee50d458c980aee6ef650f016" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33825 } } }
I20260812 01:14:32.700954 31973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:32.701268 31974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f7afeaee50d458c980aee6ef650f016. Latest consensus state: current_term: 1 leader_uuid: "1f7afeaee50d458c980aee6ef650f016" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f7afeaee50d458c980aee6ef650f016" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33825 } } }
I20260812 01:14:32.701573 31974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:32.701643 31983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:32.702253 31983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:32.703892 31983 catalog_manager.cc:1347] Generated new cluster ID: 8a991da88f9446fb864b48dd7a69c3f3
I20260812 01:14:32.703941 31983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:32.704797 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:32.692650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43240 (local address 127.17.183.190:33825)
0812 01:14:32.692863 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:32.692873 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:32.692909 (+ 36us) server_negotiation.cc:407] Connection header received
0812 01:14:32.693651 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:32.693661 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:32.693726 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:32.693904 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:32.694537 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:32.695893 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:32.696711 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:32.697374 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:32.697519 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:32.700390 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:32.700395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:32.700395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:32.700407 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:32.702976 (+ 2569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:32.703386 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:32.703389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:32.703390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:32.703512 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:32.703757 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:32.703758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:32.703758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:32.704036 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:32.704233 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:32.704353 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 01:14:32.704500 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":117,"threads_started":1}
I20260812 01:14:32.728924 31983 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:32.729667 31983 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:32.734848 31983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016: Generated new TSK 0
I20260812 01:14:32.735033 31983 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab.
Entry for principal oryx/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab.
I20260812 01:14:32.769552 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33825
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab
--principal=oryx/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:32.853397 32017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:32.853601 32017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:32.853626 32017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:32.854884 32017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:32.854928 32017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:32.854948 32017 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:14:32.854966 32017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:32.856297 32017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab
--principal=oryx/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.183.190:33825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:32.856474 32017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:32.856729 32017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:32.861629 32029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:32.861629 32027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:32.861671 32025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:32.861945 32017 server_base.cc:1034] running on GCE node
I20260812 01:14:32.862125 32017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:32.862427 32017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:32.863575 32017 hybrid_clock.cc:648] HybridClock initialized: now 1786497272863566 us; error 44 us; skew 500 ppm
Aug 12 01:14:32 dist-test-slave-rwrg krb5kdc[31803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497272, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:32.866266 32017 init.cc:377] Logged in from keytab as oryx/127.17.183.129@KRBTEST.COM (short username oryx)
I20260812 01:14:32.866679 32017 webserver.cc:460] Webserver started at http://127.17.183.129:36651/ using document root <none> and password file <none>
I20260812 01:14:32.866916 32017 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:32.866961 32017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:32.867112 32017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:32.868185 32017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "47f1d42f329d440b9cf33bd525a91414"
format_stamp: "Formatted at 2026-08-12 01:14:32 on dist-test-slave-rwrg"
server_key: "919fb61591cb923528808b61212b7e79"
server_key_iv: "1cc8a7548b7f913cfe4017d1f8615760"
server_key_version: "encryptionkey@0"
I20260812 01:14:32.868610 32017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "47f1d42f329d440b9cf33bd525a91414"
format_stamp: "Formatted at 2026-08-12 01:14:32 on dist-test-slave-rwrg"
server_key: "919fb61591cb923528808b61212b7e79"
server_key_iv: "1cc8a7548b7f913cfe4017d1f8615760"
server_key_version: "encryptionkey@0"
I20260812 01:14:32.870286 32017 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:32.871124 32039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:32.871309 32017 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:32.871400 32017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "47f1d42f329d440b9cf33bd525a91414"
format_stamp: "Formatted at 2026-08-12 01:14:32 on dist-test-slave-rwrg"
server_key: "919fb61591cb923528808b61212b7e79"
server_key_iv: "1cc8a7548b7f913cfe4017d1f8615760"
server_key_version: "encryptionkey@0"
I20260812 01:14:32.871467 32017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:32.881152 32017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:32.882997 32017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:32.883108 32017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:32.883685 32017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:32.883740 32017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:32.883764 32017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:32.883777 32017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:32.890641 32017 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:39805
I20260812 01:14:32.890736 32267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:39805 every 8 connection(s)
Aug 12 01:14:32 dist-test-slave-rwrg krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497272, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:32.891075 32017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:14:32.893993 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:32.884173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:55891 (local address 127.17.183.190:33825)
0812 01:14:32.884249 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:32.884251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:32.884422 (+ 171us) server_negotiation.cc:407] Connection header received
0812 01:14:32.885005 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:32.885006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:32.885021 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:32.885114 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:32.885959 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:32.886770 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:32.888373 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:32.888780 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:32.888860 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:32.891555 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:32.891557 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:32.891557 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:32.891564 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:32.892786 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:32.893167 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:32.893168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:32.893168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:32.893222 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:32.893445 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:32.893446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:32.893446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:32.893550 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:32.893602 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:32.893856 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 01:14:32.893927 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:14:32.894201 32057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:32.884134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33825 (local address 127.17.183.129:55891)
0812 01:14:32.884292 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:32.884332 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:32.884915 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:32.885168 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:32.885171 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:32.885520 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:32.885824 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:32.885832 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:32.886876 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:32.886878 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:32.888210 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:32.888214 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:32.888872 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:32.888874 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:32.889004 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:32.889556 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:32.889567 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:32.891467 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:32.892863 (+ 1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:32.892870 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:32.892872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:32.893093 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:32.893291 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:32.893292 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:32.893292 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:32.893391 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:32.893631 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:32.893636 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:32.893747 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 01:14:32.893837 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 01:14:32.893956 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":101,"threads_started":1}
I20260812 01:14:32.894758 32269 heartbeater.cc:347] Connected to a master server at 127.17.183.190:33825
I20260812 01:14:32.894846 32269 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:32.895045 32269 heartbeater.cc:511] Master 127.17.183.190:33825 requested a full tablet report, sending...
I20260812 01:14:32.895188 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 32017
I20260812 01:14:32.895335 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:32.895601 18142 external_mini_cluster.cc:1428] Setting key bbb59c3fbbe1b81f02aaa14b0b015453
I20260812 01:14:32.895712 31883 ts_manager.cc:194] Registered new tserver with Master: 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129:39805)
I20260812 01:14:32.896689 31883 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:55891
I20260812 01:14:32.902920 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:32.896206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:51337 (local address 127.17.183.190:33825)
0812 01:14:32.896241 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:32.896243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:32.896253 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:32.896278 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:32.896279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:32.896289 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:32.896336 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:32.896821 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:32.897521 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:32.898524 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:32.898826 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:32.898910 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:32.899887 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:32.899888 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:32.899888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:32.899894 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:32.901515 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:32.901953 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:32.901954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:32.901955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:32.902011 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:32.902370 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:32.902371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:32.902371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:32.902540 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:32.902606 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:32.902791 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 01:14:32.902855 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 01:14:32.903036 32277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:32.896029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33825 (local address 127.17.183.129:51337)
0812 01:14:32.896161 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:32.896174 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:32.896233 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:32.896380 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:32.896381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:32.896655 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:32.896726 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:32.896728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:32.897652 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:32.897653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:32.898436 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:32.898439 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:32.898912 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:32.898913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:32.898962 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:32.899437 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:32.899442 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:32.899770 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:32.901596 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:32.901597 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:32.901598 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:32.901864 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:32.902200 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:32.902201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:32.902201 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:32.902280 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:32.902624 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:32.902626 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:32.902684 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 01:14:32.902764 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 01:14:32.902892 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":70,"threads_started":1}
WARNING: no policy specified for oryx/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab.
Entry for principal oryx/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab.
I20260812 01:14:32.925102 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33825
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab
--principal=oryx/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:33.010335 32281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:33.010540 32281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:33.010564 32281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:33.011674 32281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:33.011722 32281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:33.011742 32281 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:14:33.011758 32281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:33.013230 32281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab
--principal=oryx/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.183.190:33825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:33.013425 32281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:33.013612 32281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:33.018689 32291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:33.018903 32281 server_base.cc:1034] running on GCE node
W20260812 01:14:33.018733 32290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:33.018702 32295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:33.019272 32281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:33.019471 32281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:33.020618 32281 hybrid_clock.cc:648] HybridClock initialized: now 1786497273020609 us; error 32 us; skew 500 ppm
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497273, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:33.023124 32281 init.cc:377] Logged in from keytab as oryx/127.17.183.130@KRBTEST.COM (short username oryx)
I20260812 01:14:33.023533 32281 webserver.cc:460] Webserver started at http://127.17.183.130:45095/ using document root <none> and password file <none>
I20260812 01:14:33.023725 32281 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:33.023765 32281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:33.023869 32281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:33.024957 32281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "b17adc23b5924461bd178b37e9d259e1"
format_stamp: "Formatted at 2026-08-12 01:14:33 on dist-test-slave-rwrg"
server_key: "8fd42306ac706e4bbfcbe454d41c13f9"
server_key_iv: "a86660ca70daa5192e2a0f6406ab00c1"
server_key_version: "encryptionkey@0"
I20260812 01:14:33.025271 32281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "b17adc23b5924461bd178b37e9d259e1"
format_stamp: "Formatted at 2026-08-12 01:14:33 on dist-test-slave-rwrg"
server_key: "8fd42306ac706e4bbfcbe454d41c13f9"
server_key_iv: "a86660ca70daa5192e2a0f6406ab00c1"
server_key_version: "encryptionkey@0"
I20260812 01:14:33.026623 32281 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:14:33.027343 32309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:33.027649 32281 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:33.027761 32281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "b17adc23b5924461bd178b37e9d259e1"
format_stamp: "Formatted at 2026-08-12 01:14:33 on dist-test-slave-rwrg"
server_key: "8fd42306ac706e4bbfcbe454d41c13f9"
server_key_iv: "a86660ca70daa5192e2a0f6406ab00c1"
server_key_version: "encryptionkey@0"
I20260812 01:14:33.027840 32281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:33.067236 32281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:33.069419 32281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:33.069587 32281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:33.070269 32281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:33.070329 32281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:33.070391 32281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:33.070446 32281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497273, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:33.078235 32281 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:39051
I20260812 01:14:33.078315 32541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:39051 every 8 connection(s)
I20260812 01:14:33.078712 32281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:33.081255 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.070716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:43797 (local address 127.17.183.190:33825)
0812 01:14:33.070774 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.070776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.071037 (+ 261us) server_negotiation.cc:407] Connection header received
0812 01:14:33.071630 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.071631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.071643 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.071699 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:33.072547 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.073373 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.074822 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.075070 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.075163 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.078359 (+ 3196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:33.078360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:33.078361 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:33.078368 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:33.079962 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.080341 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.080341 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.080342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.080394 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.080681 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.080681 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.080682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.080788 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:33.080844 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.081121 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.081192 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 01:14:33.081235 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 32281
I20260812 01:14:33.081382 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:33.081596 32325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.070721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33825 (local address 127.17.183.130:43797)
0812 01:14:33.070894 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.070960 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.071512 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.071800 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.071803 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.072123 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:33.072418 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.072424 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.073489 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.073491 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.074692 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.074695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.075199 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.075200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.075355 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.076047 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:33.076057 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:33.078238 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:33.080039 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:33.080047 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:33.080049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:33.080270 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:33.080455 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:33.080455 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:33.080455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:33.080623 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:33.080851 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:33.080856 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:33.080971 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.081087 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.081270 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260812 01:14:33.081605 18142 external_mini_cluster.cc:1428] Setting key a5fe092c865a446195e1ce7efe3639d3
I20260812 01:14:33.082240 32544 heartbeater.cc:347] Connected to a master server at 127.17.183.190:33825
I20260812 01:14:33.082384 32544 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:33.082584 32544 heartbeater.cc:511] Master 127.17.183.190:33825 requested a full tablet report, sending...
I20260812 01:14:33.082984 31885 ts_manager.cc:194] Registered new tserver with Master: b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051)
I20260812 01:14:33.083477 31885 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:43797
I20260812 01:14:33.089587 32559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.083188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33825 (local address 127.17.183.130:57731)
0812 01:14:33.083344 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.083353 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.083434 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.083560 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.083560 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.083795 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:33.083876 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.083878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.084810 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.084811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.085309 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.085311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.085774 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.085775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.085821 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.086321 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:33.086325 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:33.086588 (+ 263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:33.088486 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:33.088487 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:33.088488 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:33.088702 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:33.088921 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:33.088922 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:33.088922 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:33.088973 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:33.089356 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:33.089357 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:33.089392 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.089442 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.089515 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":80,"threads_started":1}
I20260812 01:14:33.089659 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.083241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:57731 (local address 127.17.183.190:33825)
0812 01:14:33.083281 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.083283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.083419 (+ 136us) server_negotiation.cc:407] Connection header received
0812 01:14:33.083491 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.083492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.083502 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.083557 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:33.083965 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.084707 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.085393 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.085691 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.085765 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.086679 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:33.086681 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:33.086681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:33.086689 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:33.088397 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.088780 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.088781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.088782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.088847 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.089036 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.089038 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.089038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.089277 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:33.089365 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.089471 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.089548 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
WARNING: no policy specified for oryx/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab.
Entry for principal oryx/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab.
I20260812 01:14:33.110916 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33825
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab
--principal=oryx/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:33.194521 32563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:33.194736 32563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:33.194758 32563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:33.195976 32563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:33.196015 32563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:33.196035 32563 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:14:33.196085 32563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:33.197614 32563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab
--principal=oryx/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.183.190:33825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:33.197852 32563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:33.198078 32563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:33.203455 32577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:33.203531 32576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:33.203454 32580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:33.203685 32563 server_base.cc:1034] running on GCE node
I20260812 01:14:33.203907 32563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:33.204156 32563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:33.205299 32563 hybrid_clock.cc:648] HybridClock initialized: now 1786497273205288 us; error 29 us; skew 500 ppm
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497273, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:33.207886 32563 init.cc:377] Logged in from keytab as oryx/127.17.183.131@KRBTEST.COM (short username oryx)
I20260812 01:14:33.208312 32563 webserver.cc:460] Webserver started at http://127.17.183.131:43311/ using document root <none> and password file <none>
I20260812 01:14:33.208633 32563 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:33.208705 32563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:33.208863 32563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:33.209918 32563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "d9de5e2cc5a349fb893b82375b29e4df"
format_stamp: "Formatted at 2026-08-12 01:14:33 on dist-test-slave-rwrg"
server_key: "87f7cd86e04ce87665a268f832d8581f"
server_key_iv: "75728df51dc33027c5eb4946ed36cbb5"
server_key_version: "encryptionkey@0"
I20260812 01:14:33.210282 32563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "d9de5e2cc5a349fb893b82375b29e4df"
format_stamp: "Formatted at 2026-08-12 01:14:33 on dist-test-slave-rwrg"
server_key: "87f7cd86e04ce87665a268f832d8581f"
server_key_iv: "75728df51dc33027c5eb4946ed36cbb5"
server_key_version: "encryptionkey@0"
I20260812 01:14:33.211591 32563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:33.212320 32605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:33.212486 32563 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:33.212618 32563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "d9de5e2cc5a349fb893b82375b29e4df"
format_stamp: "Formatted at 2026-08-12 01:14:33 on dist-test-slave-rwrg"
server_key: "87f7cd86e04ce87665a268f832d8581f"
server_key_iv: "75728df51dc33027c5eb4946ed36cbb5"
server_key_version: "encryptionkey@0"
I20260812 01:14:33.212705 32563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:33.239231 32563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:33.241261 32563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:33.241430 32563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:33.241956 32563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:33.242025 32563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:33.242069 32563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:33.242101 32563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497273, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:33.249792 32563 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:38909
I20260812 01:14:33.250145 32563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:33.250245 348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:38909 every 8 connection(s)
I20260812 01:14:33.252359 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.242475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:48673 (local address 127.17.183.190:33825)
0812 01:14:33.242552 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.242555 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.242728 (+ 173us) server_negotiation.cc:407] Connection header received
0812 01:14:33.243231 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.243233 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.243245 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.243329 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:33.244162 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.245061 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.246397 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.246737 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.246840 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.249281 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:33.249283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:33.249283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:33.249309 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:33.250895 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.251336 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.251337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.251338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.251413 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.251824 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.251825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.251825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.251931 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:33.251984 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.252233 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.252297 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 01:14:33.252625 32615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.242429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33825 (local address 127.17.183.131:48673)
0812 01:14:33.242595 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.242637 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.243136 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.243398 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.243401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.243775 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:33.244051 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.244059 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.245169 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.245170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.246293 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.246295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.246887 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.246888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.247038 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.247529 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:33.247538 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:33.249174 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:33.250968 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:33.250971 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:33.250973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:33.251271 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:33.251598 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:33.251599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:33.251599 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:33.251745 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:33.251996 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:33.252002 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:33.252116 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.252202 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.252320 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
I20260812 01:14:33.253099 353 heartbeater.cc:347] Connected to a master server at 127.17.183.190:33825
I20260812 01:14:33.253187 353 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:33.253372 353 heartbeater.cc:511] Master 127.17.183.190:33825 requested a full tablet report, sending...
I20260812 01:14:33.253791 31883 ts_manager.cc:194] Registered new tserver with Master: d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131:38909)
I20260812 01:14:33.254303 31883 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:48673
I20260812 01:14:33.256551 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 32563
I20260812 01:14:33.256662 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:33.256870 18142 external_mini_cluster.cc:1428] Setting key addde7acca66c25c4f8842d218f27235
I20260812 01:14:33.257861 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:14:33.260345 366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.254122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33825 (local address 127.17.183.131:43379)
0812 01:14:33.254483 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.254495 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.254564 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.255098 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.255098 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.255261 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:33.255310 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.255311 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.255872 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.255873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.256321 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.256322 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.256836 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.256837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.256884 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.257298 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:33.257303 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:33.257665 (+ 362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:33.259268 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:33.259270 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:33.259270 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:33.259436 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:33.259669 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:33.259671 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:33.259671 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:33.259745 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:33.260000 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:33.260001 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:33.260057 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.260145 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.260251 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":80,"threads_started":1}
I20260812 01:14:33.260339 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.254196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:43379 (local address 127.17.183.190:33825)
0812 01:14:33.254237 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.254239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.254577 (+ 338us) server_negotiation.cc:407] Connection header received
0812 01:14:33.255014 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.255015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.255027 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.255080 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:33.255373 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.255795 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.256401 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.256756 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.256828 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.257741 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:33.257742 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:33.257743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:33.257750 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:33.259165 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.259532 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.259533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.259534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.259588 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.259821 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.259822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.259823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.259932 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:33.260007 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.260172 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.260248 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497273, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 01:14:33.281752 31968 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:33.275863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43242 (local address 127.17.183.190:33825)
0812 01:14:33.275932 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.275934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.275963 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:14:33.276073 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.276074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.276092 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.276161 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:33.276840 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.277315 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.278143 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.278328 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.278436 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.281641 (+ 3205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43242: BlockingRecv error: recv got EOF from 127.0.0.1:43242 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497273, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:33.289050 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.282537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43258 (local address 127.17.183.190:33825)
0812 01:14:33.282580 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.282582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.282716 (+ 134us) server_negotiation.cc:407] Connection header received
0812 01:14:33.282753 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.282754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.282763 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.282828 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:33.283331 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.283807 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.284442 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.284719 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.284784 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.286785 (+ 2001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:33.286787 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:33.286787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:33.286792 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:33.287948 (+ 1156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.288313 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.288313 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.288314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.288364 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.288630 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.288631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.288631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.288746 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:33.288825 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.288934 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.288992 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:14:33.290731 31883 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:33.292423 31883 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:33.299269 405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.295028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:39051 (local address 127.0.0.1:46630)
0812 01:14:33.295422 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.295465 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.295533 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.295836 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.295839 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.295842 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:33.295908 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.295910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.297040 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.297041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.298156 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.298159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.298958 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.298959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.299042 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.299065 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.299141 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.299193 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":80,"threads_started":1}
I20260812 01:14:33.299332 402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.295139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46630 (local address 127.17.183.130:39051)
0812 01:14:33.295669 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.295672 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.295681 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:33.295728 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.295730 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.295747 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.295828 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:33.295986 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.296952 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.298246 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.298866 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.298960 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.299015 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.299175 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.299221 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":140,"threads_started":1}
I20260812 01:14:33.299787 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.295040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:38909 (local address 127.0.0.1:55442)
0812 01:14:33.295421 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.295465 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.295533 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.296227 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.296228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.296230 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:33.296281 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.296283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.297534 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.297536 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.298505 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.298507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.299533 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.299534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.299587 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.299590 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.299678 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.299719 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"mutex_wait_us":1,"thread_start_us":86,"threads_started":1}
I20260812 01:14:33.299841 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.295150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55442 (local address 127.17.183.131:38909)
0812 01:14:33.295375 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.295381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.295552 (+ 171us) server_negotiation.cc:407] Connection header received
0812 01:14:33.295637 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.295640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.295657 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.295714 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:33.296342 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.297437 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.298586 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.299334 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.299432 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.299488 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.299699 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.299736 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":106,"threads_started":1}
I20260812 01:14:33.300364 32393 tablet_service.cc:1467] Processing CreateTablet for tablet 779897fee3864220adcaf1e5b24b9850 (DEFAULT_TABLE table=test-table [id=02d4635653d642669c903450c3b203ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:33.300925 32393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 779897fee3864220adcaf1e5b24b9850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.301276 32686 tablet_service.cc:1467] Processing CreateTablet for tablet 779897fee3864220adcaf1e5b24b9850 (DEFAULT_TABLE table=test-table [id=02d4635653d642669c903450c3b203ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:33.301653 32686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 779897fee3864220adcaf1e5b24b9850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.304634 412 tablet_bootstrap.cc:492] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: Bootstrap starting.
I20260812 01:14:33.305140 414 tablet_bootstrap.cc:492] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: Bootstrap starting.
I20260812 01:14:33.305322 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.295422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36534 (local address 127.17.183.129:39805)
0812 01:14:33.295649 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.295654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.295958 (+ 304us) server_negotiation.cc:407] Connection header received
0812 01:14:33.296013 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.296015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.296031 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.296135 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:33.296265 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.297443 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.299722 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.300438 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.300571 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.300628 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.305150 (+ 4522us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.305205 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":104,"threads_started":1}
I20260812 01:14:33.305323 412 tablet_bootstrap.cc:654] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.305569 400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.295261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:39805 (local address 127.0.0.1:36534)
0812 01:14:33.295833 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.295843 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.295894 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.296137 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.296138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.296140 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:33.296179 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.296180 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.298585 (+ 2405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.298585 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.299612 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.299615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.300617 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.300619 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.300682 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.300686 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.305444 (+ 4758us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.305498 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":4,"thread_start_us":76,"threads_started":1}
I20260812 01:14:33.305711 412 log.cc:824] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:33.305856 414 tablet_bootstrap.cc:654] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.306259 414 log.cc:824] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:33.306288 32150 tablet_service.cc:1467] Processing CreateTablet for tablet 779897fee3864220adcaf1e5b24b9850 (DEFAULT_TABLE table=test-table [id=02d4635653d642669c903450c3b203ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:33.306730 412 tablet_bootstrap.cc:492] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: No bootstrap required, opened a new log
I20260812 01:14:33.306731 32150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 779897fee3864220adcaf1e5b24b9850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.306816 412 ts_tablet_manager.cc:1397] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:33.307169 414 tablet_bootstrap.cc:492] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: No bootstrap required, opened a new log
I20260812 01:14:33.307241 414 ts_tablet_manager.cc:1397] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:14:33.308992 412 raft_consensus.cc:348] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.309190 412 raft_consensus.cc:374] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.309230 412 raft_consensus.cc:729] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b17adc23b5924461bd178b37e9d259e1, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.309410 412 consensus_queue.cc:260] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.309406 414 raft_consensus.cc:348] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.309593 414 raft_consensus.cc:374] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.309651 414 raft_consensus.cc:729] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9de5e2cc5a349fb893b82375b29e4df, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.309724 412 ts_tablet_manager.cc:1428] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:14:33.309768 414 consensus_queue.cc:260] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.309894 32544 heartbeater.cc:503] Master 127.17.183.190:33825 was elected leader, sending a full tablet report...
I20260812 01:14:33.310065 414 ts_tablet_manager.cc:1428] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:14:33.310241 353 heartbeater.cc:503] Master 127.17.183.190:33825 was elected leader, sending a full tablet report...
I20260812 01:14:33.310073 423 tablet_bootstrap.cc:492] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: Bootstrap starting.
I20260812 01:14:33.311301 423 tablet_bootstrap.cc:654] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.311650 423 log.cc:824] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:33.312706 423 tablet_bootstrap.cc:492] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: No bootstrap required, opened a new log
I20260812 01:14:33.312790 423 ts_tablet_manager.cc:1397] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 01:14:33.314194 423 raft_consensus.cc:348] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.314348 423 raft_consensus.cc:374] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.314391 423 raft_consensus.cc:729] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f1d42f329d440b9cf33bd525a91414, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.314527 423 consensus_queue.cc:260] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.314808 423 ts_tablet_manager.cc:1428] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 01:14:33.314860 32269 heartbeater.cc:503] Master 127.17.183.190:33825 was elected leader, sending a full tablet report...
W20260812 01:14:33.329461 32546 tablet.cc:2369] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:14:33.391882 32270 tablet.cc:2369] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:14:33.501540 355 tablet.cc:2369] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:14:33.610831 424 raft_consensus.cc:482] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:33.610968 424 raft_consensus.cc:504] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.611426 424 leader_election.cc:288] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051), 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129:39805)
I20260812 01:14:33.614483 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.611890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:56559 (local address 127.17.183.129:39805)
0812 01:14:33.611937 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.611939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.612025 (+ 86us) server_negotiation.cc:407] Connection header received
0812 01:14:33.612088 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.612089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.612099 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.612148 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:33.612305 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.612795 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.613753 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.614099 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.614186 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.614196 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.614341 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.614391 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:14:33.614494 32615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.611644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:39051 (local address 127.17.183.131:43507)
0812 01:14:33.611702 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.611715 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.611776 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.611961 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.611962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.611964 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:33.612061 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.612063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.612857 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.612858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.613653 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.613655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.614167 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.614168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.614274 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.614277 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.614357 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.614393 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":34}
I20260812 01:14:33.614494 402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.611731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:43507 (local address 127.17.183.130:39051)
0812 01:14:33.611806 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.611808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.611820 (+ 12us) server_negotiation.cc:407] Connection header received
0812 01:14:33.611857 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.611858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.611869 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.611954 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:33.612159 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.612777 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.613752 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.614089 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.614143 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.614172 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.614378 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.614430 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 01:14:33.614501 430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.611769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:39805 (local address 127.17.183.131:56559)
0812 01:14:33.611948 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.611959 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.612018 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.612163 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.612164 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.612165 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:33.612231 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.612233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.612891 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.612894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.613655 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.613657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.614203 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.614204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.614269 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.614272 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.614315 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.614386 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":105,"threads_started":1}
I20260812 01:14:33.614939 32188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "779897fee3864220adcaf1e5b24b9850" candidate_uuid: "d9de5e2cc5a349fb893b82375b29e4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f1d42f329d440b9cf33bd525a91414" is_pre_election: true
I20260812 01:14:33.614986 32425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "779897fee3864220adcaf1e5b24b9850" candidate_uuid: "d9de5e2cc5a349fb893b82375b29e4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17adc23b5924461bd178b37e9d259e1" is_pre_election: true
I20260812 01:14:33.615082 32188 raft_consensus.cc:2454] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9de5e2cc5a349fb893b82375b29e4df in term 0.
I20260812 01:14:33.615177 32425 raft_consensus.cc:2454] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9de5e2cc5a349fb893b82375b29e4df in term 0.
I20260812 01:14:33.615343 32608 leader_election.cc:302] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f1d42f329d440b9cf33bd525a91414, d9de5e2cc5a349fb893b82375b29e4df; no voters:
I20260812 01:14:33.615504 424 raft_consensus.cc:2781] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:33.615569 424 raft_consensus.cc:482] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:33.615587 424 raft_consensus.cc:3037] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:33.616675 424 raft_consensus.cc:504] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.616806 424 leader_election.cc:288] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [CANDIDATE]: Term 1 election: Requested vote from peers b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051), 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129:39805)
I20260812 01:14:33.616945 32425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "779897fee3864220adcaf1e5b24b9850" candidate_uuid: "d9de5e2cc5a349fb893b82375b29e4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17adc23b5924461bd178b37e9d259e1"
I20260812 01:14:33.616972 32188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "779897fee3864220adcaf1e5b24b9850" candidate_uuid: "d9de5e2cc5a349fb893b82375b29e4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f1d42f329d440b9cf33bd525a91414"
I20260812 01:14:33.617020 32425 raft_consensus.cc:3037] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:33.617077 32188 raft_consensus.cc:3037] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:33.617800 32188 raft_consensus.cc:2454] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9de5e2cc5a349fb893b82375b29e4df in term 1.
I20260812 01:14:33.617800 32425 raft_consensus.cc:2454] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9de5e2cc5a349fb893b82375b29e4df in term 1.
I20260812 01:14:33.617986 32608 leader_election.cc:302] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b17adc23b5924461bd178b37e9d259e1, d9de5e2cc5a349fb893b82375b29e4df; no voters:
I20260812 01:14:33.618105 424 raft_consensus.cc:2781] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:33.618304 424 raft_consensus.cc:686] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 1 LEADER]: Becoming Leader. State: Replica: d9de5e2cc5a349fb893b82375b29e4df, State: Running, Role: LEADER
I20260812 01:14:33.618430 424 consensus_queue.cc:237] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.619285 31883 catalog_manager.cc:5495] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df reported cstate change: term changed from 0 to 1, leader changed from <none> to d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131). New cstate: current_term: 1 leader_uuid: "d9de5e2cc5a349fb893b82375b29e4df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } health_report { overall_health: HEALTHY } } }
I20260812 01:14:33.655651 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.653342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55452 (local address 127.17.183.131:38909)
0812 01:14:33.653385 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.653387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.653397 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:33.653446 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.653447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.653464 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.653523 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:33.653706 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.654221 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.654954 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.655142 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.655198 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.655338 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:33.655432 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:33.655484 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.655523 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.655539 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 01:14:33.657594 32188 raft_consensus.cc:1261] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Refusing update from remote peer d9de5e2cc5a349fb893b82375b29e4df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:33.657610 32425 raft_consensus.cc:1261] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Refusing update from remote peer d9de5e2cc5a349fb893b82375b29e4df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:33.657941 424 consensus_queue.cc:1035] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [LEADER]: Connected to new peer: Peer: permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:33.658116 432 consensus_queue.cc:1035] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [LEADER]: Connected to new peer: Peer: permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:33.660918 440 mvcc.cc:205] Tried to move back new op lower bound from 7317492832898600960 to 7317492832741740544. Current Snapshot: MvccSnapshot[applied={T|T < 7317492832898600960}]
I20260812 01:14:33.661115 438 mvcc.cc:205] Tried to move back new op lower bound from 7317492832898600960 to 7317492832741740544. Current Snapshot: MvccSnapshot[applied={T|T < 7317492832898600960}]
I20260812 01:14:33.662937 31883 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:33.663034 31883 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:33.663848 31883 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016: Sending DeleteTablet for 3 replicas of tablet 779897fee3864220adcaf1e5b24b9850
I20260812 01:14:33.664211 32686 tablet_service.cc:1514] Processing DeleteTablet for tablet 779897fee3864220adcaf1e5b24b9850 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:33 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:55442
I20260812 01:14:33.664232 32150 tablet_service.cc:1514] Processing DeleteTablet for tablet 779897fee3864220adcaf1e5b24b9850 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:33 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:36534
I20260812 01:14:33.664307 32393 tablet_service.cc:1514] Processing DeleteTablet for tablet 779897fee3864220adcaf1e5b24b9850 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:33 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:46630
I20260812 01:14:33.664466 452 tablet_replica.cc:330] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: stopping tablet replica
I20260812 01:14:33.664569 454 tablet_replica.cc:330] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: stopping tablet replica
I20260812 01:14:33.664647 452 raft_consensus.cc:2229] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:33.664642 31883 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:14:33.664724 454 raft_consensus.cc:2229] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 01:14:33.664783 31883 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:33.664829 454 raft_consensus.cc:2258] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:33.664855 452 raft_consensus.cc:2258] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:33.665416 454 ts_tablet_manager.cc:1905] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:33.665429 451 tablet_replica.cc:330] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: stopping tablet replica
I20260812 01:14:33.665521 451 raft_consensus.cc:2229] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:33.665676 451 raft_consensus.cc:2258] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:33.666388 32686 tablet_service.cc:1467] Processing CreateTablet for tablet eecf29501e2f424b9a6423766f8ac5ee (DEFAULT_TABLE table=test-table [id=57d5507d329e43f9be0f9ca21e1ac17e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:33.666522 32686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eecf29501e2f424b9a6423766f8ac5ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.666528 32393 tablet_service.cc:1467] Processing CreateTablet for tablet eecf29501e2f424b9a6423766f8ac5ee (DEFAULT_TABLE table=test-table [id=57d5507d329e43f9be0f9ca21e1ac17e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:33.666658 32393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eecf29501e2f424b9a6423766f8ac5ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.667480 454 ts_tablet_manager.cc:1918] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:33.667548 454 log.cc:1196] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/779897fee3864220adcaf1e5b24b9850
I20260812 01:14:33.667793 454 ts_tablet_manager.cc:1939] T 779897fee3864220adcaf1e5b24b9850 P b17adc23b5924461bd178b37e9d259e1: Deleting consensus metadata
I20260812 01:14:33.668102 412 tablet_bootstrap.cc:492] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1: Bootstrap starting.
I20260812 01:14:33.668128 32150 tablet_service.cc:1467] Processing CreateTablet for tablet eecf29501e2f424b9a6423766f8ac5ee (DEFAULT_TABLE table=test-table [id=57d5507d329e43f9be0f9ca21e1ac17e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:33.668229 32150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eecf29501e2f424b9a6423766f8ac5ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.668529 412 tablet_bootstrap.cc:654] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.669010 31857 catalog_manager.cc:4841] TS b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051): tablet 779897fee3864220adcaf1e5b24b9850 (table test-table [id=02d4635653d642669c903450c3b203ef]) successfully deleted
I20260812 01:14:33.669275 412 tablet_bootstrap.cc:492] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1: No bootstrap required, opened a new log
I20260812 01:14:33.669342 412 ts_tablet_manager.cc:1397] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:33.669497 423 tablet_bootstrap.cc:492] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414: Bootstrap starting.
I20260812 01:14:33.669670 414 tablet_bootstrap.cc:492] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df: Bootstrap starting.
I20260812 01:14:33.669684 412 raft_consensus.cc:348] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.669768 412 raft_consensus.cc:374] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.669792 412 raft_consensus.cc:729] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b17adc23b5924461bd178b37e9d259e1, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.669840 412 consensus_queue.cc:260] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.669878 423 tablet_bootstrap.cc:654] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.669950 412 ts_tablet_manager.cc:1428] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:33.670143 414 tablet_bootstrap.cc:654] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.670372 452 ts_tablet_manager.cc:1905] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:33.670789 414 tablet_bootstrap.cc:492] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df: No bootstrap required, opened a new log
I20260812 01:14:33.670828 414 ts_tablet_manager.cc:1397] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:33.670974 414 raft_consensus.cc:348] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.671052 414 raft_consensus.cc:374] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.671088 414 raft_consensus.cc:729] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9de5e2cc5a349fb893b82375b29e4df, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.671130 414 consensus_queue.cc:260] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.671223 414 ts_tablet_manager.cc:1428] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:33.672135 452 ts_tablet_manager.cc:1918] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:33.672219 452 log.cc:1196] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/779897fee3864220adcaf1e5b24b9850
I20260812 01:14:33.672245 451 ts_tablet_manager.cc:1905] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:33.672586 452 ts_tablet_manager.cc:1939] T 779897fee3864220adcaf1e5b24b9850 P d9de5e2cc5a349fb893b82375b29e4df: Deleting consensus metadata
I20260812 01:14:33.673041 31853 catalog_manager.cc:4841] TS d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131:38909): tablet 779897fee3864220adcaf1e5b24b9850 (table test-table [id=02d4635653d642669c903450c3b203ef]) successfully deleted
I20260812 01:14:33.673887 451 ts_tablet_manager.cc:1918] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:33.673975 451 log.cc:1196] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/779897fee3864220adcaf1e5b24b9850
I20260812 01:14:33.674203 451 ts_tablet_manager.cc:1939] T 779897fee3864220adcaf1e5b24b9850 P 47f1d42f329d440b9cf33bd525a91414: Deleting consensus metadata
I20260812 01:14:33.674674 31857 catalog_manager.cc:4841] TS 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129:39805): tablet 779897fee3864220adcaf1e5b24b9850 (table test-table [id=02d4635653d642669c903450c3b203ef]) successfully deleted
I20260812 01:14:33.674973 423 tablet_bootstrap.cc:492] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414: No bootstrap required, opened a new log
I20260812 01:14:33.675032 423 ts_tablet_manager.cc:1397] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260812 01:14:33.675180 423 raft_consensus.cc:348] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.675258 423 raft_consensus.cc:374] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.675287 423 raft_consensus.cc:729] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f1d42f329d440b9cf33bd525a91414, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.675339 423 consensus_queue.cc:260] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.675671 423 ts_tablet_manager.cc:1428] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:33.739643 422 raft_consensus.cc:482] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:33.739786 422 raft_consensus.cc:504] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.740182 422 leader_election.cc:288] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129:39805), d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131:38909)
I20260812 01:14:33.744065 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.740664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:46429 (local address 127.17.183.129:39805)
0812 01:14:33.740712 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.740714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.740722 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:33.740748 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.740749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.740757 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.740817 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:33.741090 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.741799 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.743264 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.743630 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.743688 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.743694 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.743948 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.743993 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 01:14:33.744069 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.740419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:51115 (local address 127.17.183.131:38909)
0812 01:14:33.740468 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.740470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.740598 (+ 128us) server_negotiation.cc:407] Connection header received
0812 01:14:33.740727 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.740728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.740740 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.740772 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:33.741019 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.741796 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.742819 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.743178 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.743272 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.743281 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.743939 (+ 658us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.743984 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:14:33.744318 459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.740361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:39805 (local address 127.17.183.130:46429)
0812 01:14:33.740610 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.740621 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.740679 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.740845 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.740846 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.740849 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:33.740957 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.740959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.741903 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.741905 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.743159 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.743162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.743746 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.743748 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.743836 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.743841 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.744166 (+ 325us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.744213 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":22,"thread_start_us":147,"threads_started":1}
I20260812 01:14:33.744333 458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.740353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:38909 (local address 127.17.183.130:51115)
0812 01:14:33.740486 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.740518 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.740633 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.740843 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.740844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.740846 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:33.740936 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.740938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.741915 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.741916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.742718 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.742720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.743769 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.743770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.743844 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.743849 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.744160 (+ 311us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.744218 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":23,"thread_start_us":67,"threads_started":1}
I20260812 01:14:33.744705 32188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eecf29501e2f424b9a6423766f8ac5ee" candidate_uuid: "b17adc23b5924461bd178b37e9d259e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f1d42f329d440b9cf33bd525a91414" is_pre_election: true
I20260812 01:14:33.744815 32188 raft_consensus.cc:2454] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b17adc23b5924461bd178b37e9d259e1 in term 0.
I20260812 01:14:33.744832 32726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eecf29501e2f424b9a6423766f8ac5ee" candidate_uuid: "b17adc23b5924461bd178b37e9d259e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9de5e2cc5a349fb893b82375b29e4df" is_pre_election: true
I20260812 01:14:33.744977 32726 raft_consensus.cc:2454] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b17adc23b5924461bd178b37e9d259e1 in term 0.
I20260812 01:14:33.745020 32314 leader_election.cc:302] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f1d42f329d440b9cf33bd525a91414, b17adc23b5924461bd178b37e9d259e1; no voters:
I20260812 01:14:33.745182 422 raft_consensus.cc:2781] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:33.745240 422 raft_consensus.cc:482] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:33.745267 422 raft_consensus.cc:3037] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:33.745921 422 raft_consensus.cc:504] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.746070 422 leader_election.cc:288] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [CANDIDATE]: Term 1 election: Requested vote from peers 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129:39805), d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131:38909)
I20260812 01:14:33.746249 32188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eecf29501e2f424b9a6423766f8ac5ee" candidate_uuid: "b17adc23b5924461bd178b37e9d259e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f1d42f329d440b9cf33bd525a91414"
I20260812 01:14:33.746265 32726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eecf29501e2f424b9a6423766f8ac5ee" candidate_uuid: "b17adc23b5924461bd178b37e9d259e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9de5e2cc5a349fb893b82375b29e4df"
I20260812 01:14:33.746330 32188 raft_consensus.cc:3037] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:33.746330 32726 raft_consensus.cc:3037] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:33.747108 32188 raft_consensus.cc:2454] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b17adc23b5924461bd178b37e9d259e1 in term 1.
I20260812 01:14:33.747119 32726 raft_consensus.cc:2454] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b17adc23b5924461bd178b37e9d259e1 in term 1.
I20260812 01:14:33.747287 32314 leader_election.cc:302] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f1d42f329d440b9cf33bd525a91414, b17adc23b5924461bd178b37e9d259e1; no voters:
I20260812 01:14:33.747387 422 raft_consensus.cc:2781] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:33.747553 422 raft_consensus.cc:686] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 1 LEADER]: Becoming Leader. State: Replica: b17adc23b5924461bd178b37e9d259e1, State: Running, Role: LEADER
I20260812 01:14:33.747629 422 consensus_queue.cc:237] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.748358 31883 catalog_manager.cc:5495] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b17adc23b5924461bd178b37e9d259e1 (127.17.183.130). New cstate: current_term: 1 leader_uuid: "b17adc23b5924461bd178b37e9d259e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } health_report { overall_health: UNKNOWN } } }
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497272, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.190@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:33.796998 473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.789438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33825 (local address 127.0.0.1:43260)
0812 01:14:33.789645 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.789656 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.789724 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.789884 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.789885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.790179 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:33.790233 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.790235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.790988 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.790989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.791650 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.791652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.792033 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.792034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.792081 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.792674 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:33.792679 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:33.794096 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:33.795915 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:33.795924 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:33.795926 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:33.796153 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:33.796353 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:33.796354 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:33.796354 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:33.796415 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:33.796667 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:33.796674 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:33.796718 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.796776 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.796872 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":105,"threads_started":1}
I20260812 01:14:33.797081 474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.789520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43260 (local address 127.17.183.190:33825)
0812 01:14:33.789744 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.789752 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.789762 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:33.789787 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.789788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.789798 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.789869 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:33.790353 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.790885 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.791752 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.791953 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.792015 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.794182 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:33.794183 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:33.794184 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:33.794190 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:33.795838 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.796226 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.796227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.796227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.796290 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.796471 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.796472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.796472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.796598 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:33.796663 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.796810 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.796945 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":196,"thread_start_us":114,"threads_started":1}
I20260812 01:14:33.799115 31883 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:43260:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 01:14:33.799356 31883 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:33.800909 32150 tablet_service.cc:1467] Processing CreateTablet for tablet 6f06276a8b664535862d676d7fe8bdc1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a20b9fe5c58a43c48033751b8aeb4425]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:14:33.800951 32393 tablet_service.cc:1467] Processing CreateTablet for tablet 6f06276a8b664535862d676d7fe8bdc1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a20b9fe5c58a43c48033751b8aeb4425]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:14:33.801002 32686 tablet_service.cc:1467] Processing CreateTablet for tablet 6f06276a8b664535862d676d7fe8bdc1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a20b9fe5c58a43c48033751b8aeb4425]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:14:33.801103 32393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f06276a8b664535862d676d7fe8bdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.801105 32150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f06276a8b664535862d676d7fe8bdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.801164 32686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f06276a8b664535862d676d7fe8bdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.802352 414 tablet_bootstrap.cc:492] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df: Bootstrap starting.
I20260812 01:14:33.802690 412 tablet_bootstrap.cc:492] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1: Bootstrap starting.
I20260812 01:14:33.802759 414 tablet_bootstrap.cc:654] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.802778 423 tablet_bootstrap.cc:492] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: Bootstrap starting.
I20260812 01:14:33.803150 412 tablet_bootstrap.cc:654] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.803467 414 tablet_bootstrap.cc:492] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df: No bootstrap required, opened a new log
I20260812 01:14:33.803462 423 tablet_bootstrap.cc:654] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.803506 414 ts_tablet_manager.cc:1397] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:33.803634 414 raft_consensus.cc:348] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.803728 414 raft_consensus.cc:374] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.803757 414 raft_consensus.cc:729] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9de5e2cc5a349fb893b82375b29e4df, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.803812 414 consensus_queue.cc:260] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.803928 414 ts_tablet_manager.cc:1428] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:33.804023 432 tablet_replica.cc:439] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } } }
I20260812 01:14:33.804113 432 tablet_replica.cc:442] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:33.804378 423 tablet_bootstrap.cc:492] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: No bootstrap required, opened a new log
I20260812 01:14:33.804435 423 ts_tablet_manager.cc:1397] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 01:14:33.804608 423 raft_consensus.cc:348] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.804694 423 raft_consensus.cc:374] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.804715 423 raft_consensus.cc:729] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f1d42f329d440b9cf33bd525a91414, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.804725 412 tablet_bootstrap.cc:492] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1: No bootstrap required, opened a new log
I20260812 01:14:33.804764 412 ts_tablet_manager.cc:1397] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 01:14:33.804776 423 consensus_queue.cc:260] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.804898 423 ts_tablet_manager.cc:1428] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:33.804908 412 raft_consensus.cc:348] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.804975 412 raft_consensus.cc:374] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.805006 412 raft_consensus.cc:729] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b17adc23b5924461bd178b37e9d259e1, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.805043 412 consensus_queue.cc:260] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.804992 429 tablet_replica.cc:439] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } } }
I20260812 01:14:33.805111 429 tablet_replica.cc:442] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:33.805130 412 ts_tablet_manager.cc:1428] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:33.805251 422 tablet_replica.cc:439] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } } }
I20260812 01:14:33.805346 422 tablet_replica.cc:442] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:33.828896 429 raft_consensus.cc:482] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:33.828987 429 raft_consensus.cc:504] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.829320 429 leader_election.cc:288] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051), d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131:38909)
I20260812 01:14:33.833431 402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.829584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:36989 (local address 127.17.183.130:39051)
0812 01:14:33.829661 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.829663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.829836 (+ 173us) server_negotiation.cc:407] Connection header received
0812 01:14:33.829930 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.829931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.829940 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.830023 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:33.830226 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.830923 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.832465 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.833028 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.833112 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.833121 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.833318 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.833357 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 01:14:33.833431 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.829655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:34681 (local address 127.17.183.131:38909)
0812 01:14:33.829706 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.829708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.829809 (+ 101us) server_negotiation.cc:407] Connection header received
0812 01:14:33.829907 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.829908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.829921 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.829995 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:33.830176 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.830972 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.832468 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.833032 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.833112 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.833121 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.833316 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.833360 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 01:14:33.833460 488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.829506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:39051 (local address 127.17.183.129:36989)
0812 01:14:33.829755 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.829766 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.829850 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.830071 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.830072 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.830074 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:33.830147 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.830149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.830995 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.830996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.832375 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.832378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.833134 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.833135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.833227 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.833232 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.833295 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.833348 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":52,"thread_start_us":123,"threads_started":1}
I20260812 01:14:33.833465 486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.829497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:38909 (local address 127.17.183.129:34681)
0812 01:14:33.829722 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.829733 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.829826 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.829998 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.829999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.830001 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:33.830077 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.830081 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.831044 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.831045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.832375 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.832378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.833131 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.833133 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.833227 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.833233 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.833295 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.833348 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":77,"thread_start_us":206,"threads_started":1}
I20260812 01:14:33.833745 32425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f06276a8b664535862d676d7fe8bdc1" candidate_uuid: "47f1d42f329d440b9cf33bd525a91414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17adc23b5924461bd178b37e9d259e1" is_pre_election: true
I20260812 01:14:33.833801 32726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f06276a8b664535862d676d7fe8bdc1" candidate_uuid: "47f1d42f329d440b9cf33bd525a91414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9de5e2cc5a349fb893b82375b29e4df" is_pre_election: true
I20260812 01:14:33.833844 32425 raft_consensus.cc:2454] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47f1d42f329d440b9cf33bd525a91414 in term 0.
I20260812 01:14:33.833890 32726 raft_consensus.cc:2454] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47f1d42f329d440b9cf33bd525a91414 in term 0.
I20260812 01:14:33.834039 32045 leader_election.cc:302] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f1d42f329d440b9cf33bd525a91414, b17adc23b5924461bd178b37e9d259e1; no voters:
I20260812 01:14:33.834209 429 raft_consensus.cc:2781] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:33.834280 429 raft_consensus.cc:482] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:33.834311 429 raft_consensus.cc:3037] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:33.835089 429 raft_consensus.cc:504] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.835239 429 leader_election.cc:288] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [CANDIDATE]: Term 1 election: Requested vote from peers b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051), d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131:38909)
I20260812 01:14:33.835392 32425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f06276a8b664535862d676d7fe8bdc1" candidate_uuid: "47f1d42f329d440b9cf33bd525a91414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17adc23b5924461bd178b37e9d259e1"
I20260812 01:14:33.835399 32726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f06276a8b664535862d676d7fe8bdc1" candidate_uuid: "47f1d42f329d440b9cf33bd525a91414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9de5e2cc5a349fb893b82375b29e4df"
I20260812 01:14:33.835469 32425 raft_consensus.cc:3037] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:33.835469 32726 raft_consensus.cc:3037] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:33.836218 32425 raft_consensus.cc:2454] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47f1d42f329d440b9cf33bd525a91414 in term 1.
I20260812 01:14:33.836218 32726 raft_consensus.cc:2454] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47f1d42f329d440b9cf33bd525a91414 in term 1.
I20260812 01:14:33.836382 32042 leader_election.cc:302] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f1d42f329d440b9cf33bd525a91414, d9de5e2cc5a349fb893b82375b29e4df; no voters:
I20260812 01:14:33.836515 429 raft_consensus.cc:2781] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:33.836669 429 raft_consensus.cc:686] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [term 1 LEADER]: Becoming Leader. State: Replica: 47f1d42f329d440b9cf33bd525a91414, State: Running, Role: LEADER
I20260812 01:14:33.836724 429 consensus_queue.cc:237] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.837069 490 tablet_replica.cc:439] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: TxnStatusTablet state changed. Reason: New leader 47f1d42f329d440b9cf33bd525a91414. Latest consensus state: current_term: 1 leader_uuid: "47f1d42f329d440b9cf33bd525a91414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } } }
I20260812 01:14:33.837165 490 tablet_replica.cc:442] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:14:33.837415 495 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 01:14:33.837528 495 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 01:14:33.837445 31885 catalog_manager.cc:5495] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129). New cstate: current_term: 1 leader_uuid: "47f1d42f329d440b9cf33bd525a91414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260812 01:14:33.843350 473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.840621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:39805 (local address 127.0.0.1:36536)
0812 01:14:33.840694 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.840705 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.840760 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.840929 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.840929 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.840931 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:14:33.840971 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.840973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.841813 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.841814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.842351 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.842353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.842822 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.842823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.842866 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.842881 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:14:33.843214 (+ 333us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:14:33.843220 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.843257 (+ 37us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.843296 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 01:14:33.843366 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.840628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36536 (local address 127.17.183.129:39805)
0812 01:14:33.840683 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.840686 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.840760 (+ 74us) server_negotiation.cc:407] Connection header received
0812 01:14:33.840824 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.840825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.840844 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.840930 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:33.841015 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.841717 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.842442 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.842731 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.842807 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.842978 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:33.843139 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:33.843227 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.843272 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.843294 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 01:14:33.844445 32425 raft_consensus.cc:1261] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Refusing update from remote peer 47f1d42f329d440b9cf33bd525a91414: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:33.844569 32726 raft_consensus.cc:1261] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Refusing update from remote peer 47f1d42f329d440b9cf33bd525a91414: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:33.844730 429 consensus_queue.cc:1035] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:33.845031 429 consensus_queue.cc:1035] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:33.845366 422 tablet_replica.cc:439] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1: TxnStatusTablet state changed. Reason: New leader 47f1d42f329d440b9cf33bd525a91414. Latest consensus state: current_term: 1 leader_uuid: "47f1d42f329d440b9cf33bd525a91414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } } }
I20260812 01:14:33.845456 422 tablet_replica.cc:442] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:33.845667 432 tablet_replica.cc:439] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df: TxnStatusTablet state changed. Reason: New leader 47f1d42f329d440b9cf33bd525a91414. Latest consensus state: current_term: 1 leader_uuid: "47f1d42f329d440b9cf33bd525a91414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } } }
I20260812 01:14:33.845764 432 tablet_replica.cc:442] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:33.846007 429 tablet_replica.cc:439] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "47f1d42f329d440b9cf33bd525a91414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } } }
I20260812 01:14:33.846091 429 tablet_replica.cc:442] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:14:33.846508 422 tablet_replica.cc:439] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "47f1d42f329d440b9cf33bd525a91414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } } }
I20260812 01:14:33.846585 422 tablet_replica.cc:442] T 6f06276a8b664535862d676d7fe8bdc1 P b17adc23b5924461bd178b37e9d259e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:33.847873 429 tablet_replica.cc:439] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "47f1d42f329d440b9cf33bd525a91414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } } }
I20260812 01:14:33.847960 429 tablet_replica.cc:442] T 6f06276a8b664535862d676d7fe8bdc1 P 47f1d42f329d440b9cf33bd525a91414: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:14:33.848336 436 mvcc.cc:205] Tried to move back new op lower bound from 7317492833665007616 to 7317492833635713024. Current Snapshot: MvccSnapshot[applied={T|T < 7317492833665007616}]
I20260812 01:14:33.848429 432 tablet_replica.cc:439] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "47f1d42f329d440b9cf33bd525a91414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } } }
I20260812 01:14:33.848511 432 tablet_replica.cc:442] T 6f06276a8b664535862d676d7fe8bdc1 P d9de5e2cc5a349fb893b82375b29e4df: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:14:33.850952 402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.847969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46638 (local address 127.17.183.130:39051)
0812 01:14:33.848007 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.848009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.848019 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:33.848100 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.848101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.848121 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.848182 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:33.848595 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.849134 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.850218 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.850389 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.850437 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.850612 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:33.850697 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:33.850748 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.850828 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.850844 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:14:33.856065 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.853483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:34395 (local address 127.17.183.129:39805)
0812 01:14:33.853526 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.853528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.853647 (+ 119us) server_negotiation.cc:407] Connection header received
0812 01:14:33.853708 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.853708 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.853717 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.853768 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:33.853949 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.854343 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.855411 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.855576 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.855632 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.855827 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:33.855849 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:33.855947 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.856006 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.856022 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:14:33.856137 510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.853412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:39805 (local address 127.17.183.130:34395)
0812 01:14:33.853577 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.853587 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.853661 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.853796 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.853797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.853799 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:14:33.853868 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.853869 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.854409 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.854410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.855334 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.855336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.855655 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.855656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.855721 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.855737 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:14:33.855954 (+ 217us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:14:33.855955 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.856005 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.856041 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":96,"threads_started":1}
I20260812 01:14:33.858433 32188 raft_consensus.cc:1261] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Refusing update from remote peer b17adc23b5924461bd178b37e9d259e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:33.858572 32726 raft_consensus.cc:1261] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Refusing update from remote peer b17adc23b5924461bd178b37e9d259e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:33.858741 461 consensus_queue.cc:1035] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:33.858831 422 consensus_queue.cc:1035] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:33.868006 402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.865389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:41405 (local address 127.17.183.130:39051)
0812 01:14:33.865425 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.865427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.865564 (+ 137us) server_negotiation.cc:407] Connection header received
0812 01:14:33.865621 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.865622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.865631 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.865683 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:33.865822 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.866267 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.867224 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.867512 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.867606 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.867781 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:33.867812 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:33.867855 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.867921 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.867938 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 01:14:33.868124 524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.865349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:39051 (local address 127.17.183.129:41405)
0812 01:14:33.865497 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:33.865507 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:33.865564 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:33.865686 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:33.865686 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:33.865688 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:14:33.865742 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.865743 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.866343 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.866344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.867153 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:33.867155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.867623 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.867624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:33.867690 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.867703 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:14:33.867866 (+ 163us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:14:33.867868 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:14:33.867916 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 01:14:33.867957 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
I20260812 01:14:33.877560 31883 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:33.877673 31883 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:33.878293 31883 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016: Sending DeleteTablet for 3 replicas of tablet eecf29501e2f424b9a6423766f8ac5ee
I20260812 01:14:33.878548 32150 tablet_service.cc:1514] Processing DeleteTablet for tablet eecf29501e2f424b9a6423766f8ac5ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:33 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:36534
I20260812 01:14:33.878649 451 tablet_replica.cc:330] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414: stopping tablet replica
I20260812 01:14:33.878650 32393 tablet_service.cc:1514] Processing DeleteTablet for tablet eecf29501e2f424b9a6423766f8ac5ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:33 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:46630
I20260812 01:14:33.878635 32686 tablet_service.cc:1514] Processing DeleteTablet for tablet eecf29501e2f424b9a6423766f8ac5ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:33 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:55442
I20260812 01:14:33.878692 451 raft_consensus.cc:2229] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:33.878727 451 raft_consensus.cc:2258] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:33.878733 454 tablet_replica.cc:330] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1: stopping tablet replica
I20260812 01:14:33.878773 454 raft_consensus.cc:2229] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:33.878856 454 raft_consensus.cc:2258] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:33.881311 452 tablet_replica.cc:330] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df: stopping tablet replica
I20260812 01:14:33.881384 452 raft_consensus.cc:2229] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:33.881443 452 raft_consensus.cc:2258] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:33.881582 454 ts_tablet_manager.cc:1905] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:33.881943 451 ts_tablet_manager.cc:1905] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:33.883392 454 ts_tablet_manager.cc:1918] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:33.883451 454 log.cc:1196] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/eecf29501e2f424b9a6423766f8ac5ee
I20260812 01:14:33.883543 451 ts_tablet_manager.cc:1918] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:33.883601 451 log.cc:1196] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/eecf29501e2f424b9a6423766f8ac5ee
I20260812 01:14:33.883679 454 ts_tablet_manager.cc:1939] T eecf29501e2f424b9a6423766f8ac5ee P b17adc23b5924461bd178b37e9d259e1: Deleting consensus metadata
I20260812 01:14:33.883814 451 ts_tablet_manager.cc:1939] T eecf29501e2f424b9a6423766f8ac5ee P 47f1d42f329d440b9cf33bd525a91414: Deleting consensus metadata
I20260812 01:14:33.884133 31857 catalog_manager.cc:4841] TS b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051): tablet eecf29501e2f424b9a6423766f8ac5ee (table test-table [id=57d5507d329e43f9be0f9ca21e1ac17e]) successfully deleted
I20260812 01:14:33.884212 31857 catalog_manager.cc:4841] TS 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129:39805): tablet eecf29501e2f424b9a6423766f8ac5ee (table test-table [id=57d5507d329e43f9be0f9ca21e1ac17e]) successfully deleted
I20260812 01:14:33.884728 452 ts_tablet_manager.cc:1905] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:33.886529 452 ts_tablet_manager.cc:1918] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:33.886595 452 log.cc:1196] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/eecf29501e2f424b9a6423766f8ac5ee
I20260812 01:14:33.886811 452 ts_tablet_manager.cc:1939] T eecf29501e2f424b9a6423766f8ac5ee P d9de5e2cc5a349fb893b82375b29e4df: Deleting consensus metadata
I20260812 01:14:33.887217 31853 catalog_manager.cc:4841] TS d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131:38909): tablet eecf29501e2f424b9a6423766f8ac5ee (table test-table [id=57d5507d329e43f9be0f9ca21e1ac17e]) successfully deleted
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 01:14:33.920013 474 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:33.912817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43272 (local address 127.17.183.190:33825)
0812 01:14:33.912881 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.912884 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.913024 (+ 140us) server_negotiation.cc:407] Connection header received
0812 01:14:33.913087 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.913088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.913103 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.913170 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:33.913890 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.914736 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.915801 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.916257 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.916347 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.919942 (+ 3595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43272: BlockingRecv error: recv got EOF from 127.0.0.1:43272 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 12 01:14:33 dist-test-slave-rwrg krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM
I20260812 01:14:33.930215 474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:33.921178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43276 (local address 127.17.183.190:33825)
0812 01:14:33.921219 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:33.921221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:33.921476 (+ 255us) server_negotiation.cc:407] Connection header received
0812 01:14:33.921527 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:33.921528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:33.921543 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:33.921613 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:33.922200 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.922959 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.924004 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:33.924280 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:33.924358 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:33.927115 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:33.927117 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:33.927118 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:33.927127 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:33.928861 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.929277 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.929279 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.929279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.929345 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:33.929624 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:33.929625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:33.929625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:33.929772 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:33.929879 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:33.930027 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 01:14:33.930114 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 01:14:33.932062 31883 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:33.932256 31883 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:33.933709 32686 tablet_service.cc:1467] Processing CreateTablet for tablet e1f97b4943f0467c934456d74d27b1c4 (DEFAULT_TABLE table=test-table [id=1bb969ff921147fd9f4c53d5f4ba9c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:33.933708 32150 tablet_service.cc:1467] Processing CreateTablet for tablet e1f97b4943f0467c934456d74d27b1c4 (DEFAULT_TABLE table=test-table [id=1bb969ff921147fd9f4c53d5f4ba9c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:33.933790 32393 tablet_service.cc:1467] Processing CreateTablet for tablet e1f97b4943f0467c934456d74d27b1c4 (DEFAULT_TABLE table=test-table [id=1bb969ff921147fd9f4c53d5f4ba9c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:33.933861 32150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1f97b4943f0467c934456d74d27b1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.933861 32686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1f97b4943f0467c934456d74d27b1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.933943 32393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1f97b4943f0467c934456d74d27b1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:33.935256 414 tablet_bootstrap.cc:492] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df: Bootstrap starting.
I20260812 01:14:33.935256 423 tablet_bootstrap.cc:492] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414: Bootstrap starting.
I20260812 01:14:33.935369 412 tablet_bootstrap.cc:492] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1: Bootstrap starting.
I20260812 01:14:33.935616 414 tablet_bootstrap.cc:654] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.935678 423 tablet_bootstrap.cc:654] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.935832 412 tablet_bootstrap.cc:654] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:33.937188 414 tablet_bootstrap.cc:492] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df: No bootstrap required, opened a new log
I20260812 01:14:33.937244 414 ts_tablet_manager.cc:1397] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:14:33.937351 414 raft_consensus.cc:348] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.937433 414 raft_consensus.cc:374] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.937453 414 raft_consensus.cc:729] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9de5e2cc5a349fb893b82375b29e4df, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.937491 414 consensus_queue.cc:260] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.937584 414 ts_tablet_manager.cc:1428] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:33.938282 412 tablet_bootstrap.cc:492] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1: No bootstrap required, opened a new log
I20260812 01:14:33.938338 412 ts_tablet_manager.cc:1397] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 01:14:33.938489 412 raft_consensus.cc:348] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.938568 412 raft_consensus.cc:374] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.938593 412 raft_consensus.cc:729] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b17adc23b5924461bd178b37e9d259e1, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.938670 412 consensus_queue.cc:260] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.938753 412 ts_tablet_manager.cc:1428] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:33.940928 423 tablet_bootstrap.cc:492] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414: No bootstrap required, opened a new log
I20260812 01:14:33.941001 423 ts_tablet_manager.cc:1397] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260812 01:14:33.941170 423 raft_consensus.cc:348] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.941244 423 raft_consensus.cc:374] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:33.941268 423 raft_consensus.cc:729] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f1d42f329d440b9cf33bd525a91414, State: Initialized, Role: FOLLOWER
I20260812 01:14:33.941319 423 consensus_queue.cc:260] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:33.941413 423 ts_tablet_manager.cc:1428] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:34.203531 432 raft_consensus.cc:482] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:34.203660 432 raft_consensus.cc:504] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.203867 432 leader_election.cc:288] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129:39805), b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051)
I20260812 01:14:34.204114 32188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f97b4943f0467c934456d74d27b1c4" candidate_uuid: "d9de5e2cc5a349fb893b82375b29e4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f1d42f329d440b9cf33bd525a91414" is_pre_election: true
I20260812 01:14:34.204210 32188 raft_consensus.cc:2454] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9de5e2cc5a349fb893b82375b29e4df in term 0.
I20260812 01:14:34.204156 32425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f97b4943f0467c934456d74d27b1c4" candidate_uuid: "d9de5e2cc5a349fb893b82375b29e4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17adc23b5924461bd178b37e9d259e1" is_pre_election: true
I20260812 01:14:34.204293 32425 raft_consensus.cc:2454] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9de5e2cc5a349fb893b82375b29e4df in term 0.
I20260812 01:14:34.204370 32608 leader_election.cc:302] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f1d42f329d440b9cf33bd525a91414, d9de5e2cc5a349fb893b82375b29e4df; no voters:
I20260812 01:14:34.204471 432 raft_consensus.cc:2781] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:34.204548 432 raft_consensus.cc:482] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:34.204576 432 raft_consensus.cc:3037] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:34.205272 432 raft_consensus.cc:504] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.205420 432 leader_election.cc:288] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [CANDIDATE]: Term 1 election: Requested vote from peers 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129:39805), b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051)
I20260812 01:14:34.205629 32188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f97b4943f0467c934456d74d27b1c4" candidate_uuid: "d9de5e2cc5a349fb893b82375b29e4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f1d42f329d440b9cf33bd525a91414"
I20260812 01:14:34.205633 32425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f97b4943f0467c934456d74d27b1c4" candidate_uuid: "d9de5e2cc5a349fb893b82375b29e4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17adc23b5924461bd178b37e9d259e1"
I20260812 01:14:34.205711 32188 raft_consensus.cc:3037] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:34.205713 32425 raft_consensus.cc:3037] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:34.206542 32425 raft_consensus.cc:2454] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9de5e2cc5a349fb893b82375b29e4df in term 1.
I20260812 01:14:34.206542 32188 raft_consensus.cc:2454] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9de5e2cc5a349fb893b82375b29e4df in term 1.
I20260812 01:14:34.206717 32608 leader_election.cc:302] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f1d42f329d440b9cf33bd525a91414, d9de5e2cc5a349fb893b82375b29e4df; no voters:
I20260812 01:14:34.206807 432 raft_consensus.cc:2781] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:34.206956 432 raft_consensus.cc:686] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 1 LEADER]: Becoming Leader. State: Replica: d9de5e2cc5a349fb893b82375b29e4df, State: Running, Role: LEADER
I20260812 01:14:34.207028 432 consensus_queue.cc:237] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.207687 31885 catalog_manager.cc:5495] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df reported cstate change: term changed from 0 to 1, leader changed from <none> to d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131). New cstate: current_term: 1 leader_uuid: "d9de5e2cc5a349fb893b82375b29e4df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } health_report { overall_health: HEALTHY } } }
I20260812 01:14:34.222370 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:34.220305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55464 (local address 127.17.183.131:38909)
0812 01:14:34.220366 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:34.220368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:34.220376 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:34.220476 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:34.220477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:34.220511 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:34.220578 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:34.220710 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:34.221177 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:34.221817 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:34.221993 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:34.222042 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:34.222152 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:34.222176 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:34.222211 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:34.222265 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 01:14:34.222282 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 01:14:34.223080 32425 raft_consensus.cc:1261] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Refusing update from remote peer d9de5e2cc5a349fb893b82375b29e4df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:34.223099 32188 raft_consensus.cc:1261] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Refusing update from remote peer d9de5e2cc5a349fb893b82375b29e4df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:34.223337 555 consensus_queue.cc:1035] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [LEADER]: Connected to new peer: Peer: permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:34.223510 432 consensus_queue.cc:1035] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [LEADER]: Connected to new peer: Peer: permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:34.226188 31885 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:34.226292 31885 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:34.226887 31885 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016: Sending DeleteTablet for 3 replicas of tablet e1f97b4943f0467c934456d74d27b1c4
I20260812 01:14:34.227169 32150 tablet_service.cc:1514] Processing DeleteTablet for tablet e1f97b4943f0467c934456d74d27b1c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:34 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:36534
I20260812 01:14:34.227166 32686 tablet_service.cc:1514] Processing DeleteTablet for tablet e1f97b4943f0467c934456d74d27b1c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:34 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:55442
I20260812 01:14:34.227269 451 tablet_replica.cc:330] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414: stopping tablet replica
I20260812 01:14:34.227267 32393 tablet_service.cc:1514] Processing DeleteTablet for tablet e1f97b4943f0467c934456d74d27b1c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:34 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:46630
I20260812 01:14:34.227325 451 raft_consensus.cc:2229] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:34.227350 452 tablet_replica.cc:330] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df: stopping tablet replica
I20260812 01:14:34.227373 451 raft_consensus.cc:2258] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:34.227356 454 tablet_replica.cc:330] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1: stopping tablet replica
I20260812 01:14:34.227397 452 raft_consensus.cc:2229] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:34.227447 454 raft_consensus.cc:2229] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:34.227456 452 raft_consensus.cc:2258] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:34.227500 454 raft_consensus.cc:2258] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:34.227614 31885 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:14:34.227707 451 ts_tablet_manager.cc:1905] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 01:14:34.227748 31885 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:34.227883 452 ts_tablet_manager.cc:1905] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:34.227878 454 ts_tablet_manager.cc:1905] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:34.229025 32686 tablet_service.cc:1467] Processing CreateTablet for tablet 1d16dac00f0c4ed5864e226d84c5e9de (DEFAULT_TABLE table=test-table [id=e3cae8c63ad2424694f50518f68cf95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:34.229136 32686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d16dac00f0c4ed5864e226d84c5e9de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:34.229532 32393 tablet_service.cc:1467] Processing CreateTablet for tablet 1d16dac00f0c4ed5864e226d84c5e9de (DEFAULT_TABLE table=test-table [id=e3cae8c63ad2424694f50518f68cf95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:34.229549 32150 tablet_service.cc:1467] Processing CreateTablet for tablet 1d16dac00f0c4ed5864e226d84c5e9de (DEFAULT_TABLE table=test-table [id=e3cae8c63ad2424694f50518f68cf95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:34.229575 454 ts_tablet_manager.cc:1918] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:34.229626 454 log.cc:1196] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/e1f97b4943f0467c934456d74d27b1c4
I20260812 01:14:34.229643 32393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d16dac00f0c4ed5864e226d84c5e9de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:34.229688 452 ts_tablet_manager.cc:1918] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:34.229749 452 log.cc:1196] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/e1f97b4943f0467c934456d74d27b1c4
I20260812 01:14:34.229854 454 ts_tablet_manager.cc:1939] T e1f97b4943f0467c934456d74d27b1c4 P b17adc23b5924461bd178b37e9d259e1: Deleting consensus metadata
I20260812 01:14:34.230020 452 ts_tablet_manager.cc:1939] T e1f97b4943f0467c934456d74d27b1c4 P d9de5e2cc5a349fb893b82375b29e4df: Deleting consensus metadata
I20260812 01:14:34.230178 31857 catalog_manager.cc:4841] TS b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051): tablet e1f97b4943f0467c934456d74d27b1c4 (table test-table [id=1bb969ff921147fd9f4c53d5f4ba9c85]) successfully deleted
I20260812 01:14:34.230381 31853 catalog_manager.cc:4841] TS d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131:38909): tablet e1f97b4943f0467c934456d74d27b1c4 (table test-table [id=1bb969ff921147fd9f4c53d5f4ba9c85]) successfully deleted
I20260812 01:14:34.230487 414 tablet_bootstrap.cc:492] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df: Bootstrap starting.
I20260812 01:14:34.230792 414 tablet_bootstrap.cc:654] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:34.230984 412 tablet_bootstrap.cc:492] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1: Bootstrap starting.
I20260812 01:14:34.231079 451 ts_tablet_manager.cc:1918] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:34.231138 451 log.cc:1196] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/e1f97b4943f0467c934456d74d27b1c4
I20260812 01:14:34.231263 412 tablet_bootstrap.cc:654] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:34.231359 451 ts_tablet_manager.cc:1939] T e1f97b4943f0467c934456d74d27b1c4 P 47f1d42f329d440b9cf33bd525a91414: Deleting consensus metadata
I20260812 01:14:34.231457 414 tablet_bootstrap.cc:492] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df: No bootstrap required, opened a new log
I20260812 01:14:34.231501 414 ts_tablet_manager.cc:1397] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:34.231566 32150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d16dac00f0c4ed5864e226d84c5e9de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:34.231613 414 raft_consensus.cc:348] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.231673 414 raft_consensus.cc:374] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:34.231691 414 raft_consensus.cc:729] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9de5e2cc5a349fb893b82375b29e4df, State: Initialized, Role: FOLLOWER
I20260812 01:14:34.231729 414 consensus_queue.cc:260] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.231828 414 ts_tablet_manager.cc:1428] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:34.231822 31857 catalog_manager.cc:4841] TS 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129:39805): tablet e1f97b4943f0467c934456d74d27b1c4 (table test-table [id=1bb969ff921147fd9f4c53d5f4ba9c85]) successfully deleted
I20260812 01:14:34.231889 412 tablet_bootstrap.cc:492] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1: No bootstrap required, opened a new log
I20260812 01:14:34.231926 412 ts_tablet_manager.cc:1397] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 01:14:34.232028 412 raft_consensus.cc:348] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.232095 412 raft_consensus.cc:374] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:34.232120 412 raft_consensus.cc:729] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b17adc23b5924461bd178b37e9d259e1, State: Initialized, Role: FOLLOWER
I20260812 01:14:34.232162 412 consensus_queue.cc:260] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.232259 412 ts_tablet_manager.cc:1428] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:34.232653 423 tablet_bootstrap.cc:492] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414: Bootstrap starting.
I20260812 01:14:34.232925 423 tablet_bootstrap.cc:654] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:34.233426 423 tablet_bootstrap.cc:492] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414: No bootstrap required, opened a new log
I20260812 01:14:34.233489 423 ts_tablet_manager.cc:1397] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:34.233605 423 raft_consensus.cc:348] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.233675 423 raft_consensus.cc:374] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:34.233696 423 raft_consensus.cc:729] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f1d42f329d440b9cf33bd525a91414, State: Initialized, Role: FOLLOWER
I20260812 01:14:34.233755 423 consensus_queue.cc:260] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.233862 423 ts_tablet_manager.cc:1428] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:34.241981 504 raft_consensus.cc:482] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:34.242061 504 raft_consensus.cc:504] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.242218 504 leader_election.cc:288] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051), d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131:38909)
I20260812 01:14:34.242383 32425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d16dac00f0c4ed5864e226d84c5e9de" candidate_uuid: "47f1d42f329d440b9cf33bd525a91414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17adc23b5924461bd178b37e9d259e1" is_pre_election: true
I20260812 01:14:34.242400 32726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d16dac00f0c4ed5864e226d84c5e9de" candidate_uuid: "47f1d42f329d440b9cf33bd525a91414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9de5e2cc5a349fb893b82375b29e4df" is_pre_election: true
I20260812 01:14:34.242462 32425 raft_consensus.cc:2454] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47f1d42f329d440b9cf33bd525a91414 in term 0.
I20260812 01:14:34.242479 32726 raft_consensus.cc:2454] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47f1d42f329d440b9cf33bd525a91414 in term 0.
I20260812 01:14:34.242619 32045 leader_election.cc:302] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f1d42f329d440b9cf33bd525a91414, b17adc23b5924461bd178b37e9d259e1; no voters:
I20260812 01:14:34.242719 504 raft_consensus.cc:2781] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:34.242797 504 raft_consensus.cc:482] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:34.242830 504 raft_consensus.cc:3037] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:34.243567 504 raft_consensus.cc:504] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.243736 504 leader_election.cc:288] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [CANDIDATE]: Term 1 election: Requested vote from peers b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051), d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131:38909)
I20260812 01:14:34.243885 32425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d16dac00f0c4ed5864e226d84c5e9de" candidate_uuid: "47f1d42f329d440b9cf33bd525a91414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17adc23b5924461bd178b37e9d259e1"
I20260812 01:14:34.243958 32425 raft_consensus.cc:3037] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:34.244045 32726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d16dac00f0c4ed5864e226d84c5e9de" candidate_uuid: "47f1d42f329d440b9cf33bd525a91414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9de5e2cc5a349fb893b82375b29e4df"
I20260812 01:14:34.244118 32726 raft_consensus.cc:3037] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:34.244694 32425 raft_consensus.cc:2454] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47f1d42f329d440b9cf33bd525a91414 in term 1.
I20260812 01:14:34.244863 32045 leader_election.cc:302] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f1d42f329d440b9cf33bd525a91414, b17adc23b5924461bd178b37e9d259e1; no voters:
I20260812 01:14:34.244973 504 raft_consensus.cc:2781] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:34.245008 32726 raft_consensus.cc:2454] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47f1d42f329d440b9cf33bd525a91414 in term 1.
I20260812 01:14:34.245035 504 raft_consensus.cc:686] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 1 LEADER]: Becoming Leader. State: Replica: 47f1d42f329d440b9cf33bd525a91414, State: Running, Role: LEADER
I20260812 01:14:34.245091 504 consensus_queue.cc:237] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } }
I20260812 01:14:34.245661 31885 catalog_manager.cc:5495] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129). New cstate: current_term: 1 leader_uuid: "47f1d42f329d440b9cf33bd525a91414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f1d42f329d440b9cf33bd525a91414" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260812 01:14:34.253233 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:34.250547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35118 (local address 127.17.183.129:39805)
0812 01:14:34.250586 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:34.250588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:34.250653 (+ 65us) server_negotiation.cc:407] Connection header received
0812 01:14:34.250717 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:34.250718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:34.250725 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:34.250770 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:34.250895 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:34.251408 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:34.252476 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:34.252777 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:34.252867 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:34.253016 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:34.253043 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:34.253083 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:34.253157 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 01:14:34.253177 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:14:34.256886 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:34.255130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:37769 (local address 127.17.183.129:39805)
0812 01:14:34.255167 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:34.255169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:34.255198 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:14:34.255261 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:34.255261 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:34.255269 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:34.255327 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:34.255391 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:34.255772 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:34.256358 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:34.256558 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:34.256618 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:34.256710 (+ 92us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:34.256731 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:34.256767 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:34.256795 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 01:14:34.256826 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 01:14:34.256901 524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:34.255084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:39805 (local address 127.17.183.129:37769)
0812 01:14:34.255158 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:34.255168 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:34.255216 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:34.255331 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:34.255331 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:34.255332 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:14:34.255361 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:34.255362 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:34.255825 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:34.255826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:34.256292 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:34.256294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:34.256615 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:34.256616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:34.256651 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:34.256656 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:14:34.256766 (+ 110us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:14:34.256767 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 01:14:34.256793 (+ 26us) client_negotiation.cc:240] Negotiation successful
0812 01:14:34.256841 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 01:14:34.258432 32726 raft_consensus.cc:1261] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Refusing update from remote peer 47f1d42f329d440b9cf33bd525a91414: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:34.258455 32425 raft_consensus.cc:1261] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Refusing update from remote peer 47f1d42f329d440b9cf33bd525a91414: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:34.258635 490 consensus_queue.cc:1035] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b17adc23b5924461bd178b37e9d259e1" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:34.258759 504 consensus_queue.cc:1035] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9de5e2cc5a349fb893b82375b29e4df" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:34.268854 31883 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:34.268950 31883 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:34.269629 31883 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f7afeaee50d458c980aee6ef650f016: Sending DeleteTablet for 3 replicas of tablet 1d16dac00f0c4ed5864e226d84c5e9de
I20260812 01:14:34.269904 32686 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d16dac00f0c4ed5864e226d84c5e9de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:34 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:55442
I20260812 01:14:34.269927 32146 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d16dac00f0c4ed5864e226d84c5e9de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:34 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:36534
I20260812 01:14:34.270005 451 tablet_replica.cc:330] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414: stopping tablet replica
I20260812 01:14:34.270004 452 tablet_replica.cc:330] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df: stopping tablet replica
I20260812 01:14:34.270045 451 raft_consensus.cc:2229] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:34.270058 452 raft_consensus.cc:2229] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:34.270089 452 raft_consensus.cc:2258] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:34.270133 451 raft_consensus.cc:2258] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:34.270293 32393 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d16dac00f0c4ed5864e226d84c5e9de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:34 UTC) from {username='oryx', principal='oryx/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:46630
I20260812 01:14:34.270383 454 tablet_replica.cc:330] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1: stopping tablet replica
I20260812 01:14:34.270428 454 raft_consensus.cc:2229] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:34.270457 454 raft_consensus.cc:2258] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:34.270499 452 ts_tablet_manager.cc:1905] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:34.270754 454 ts_tablet_manager.cc:1905] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:34.270834 451 ts_tablet_manager.cc:1905] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:34.272178 452 ts_tablet_manager.cc:1918] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:34.272230 452 log.cc:1196] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/1d16dac00f0c4ed5864e226d84c5e9de
I20260812 01:14:34.272262 451 ts_tablet_manager.cc:1918] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:34.272320 451 log.cc:1196] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/1d16dac00f0c4ed5864e226d84c5e9de
I20260812 01:14:34.272321 454 ts_tablet_manager.cc:1918] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:14:34.272382 454 log.cc:1196] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/1d16dac00f0c4ed5864e226d84c5e9de
I20260812 01:14:34.272451 452 ts_tablet_manager.cc:1939] T 1d16dac00f0c4ed5864e226d84c5e9de P d9de5e2cc5a349fb893b82375b29e4df: Deleting consensus metadata
I20260812 01:14:34.272575 451 ts_tablet_manager.cc:1939] T 1d16dac00f0c4ed5864e226d84c5e9de P 47f1d42f329d440b9cf33bd525a91414: Deleting consensus metadata
I20260812 01:14:34.272627 454 ts_tablet_manager.cc:1939] T 1d16dac00f0c4ed5864e226d84c5e9de P b17adc23b5924461bd178b37e9d259e1: Deleting consensus metadata
I20260812 01:14:34.272950 31853 catalog_manager.cc:4841] TS d9de5e2cc5a349fb893b82375b29e4df (127.17.183.131:38909): tablet 1d16dac00f0c4ed5864e226d84c5e9de (table test-table [id=e3cae8c63ad2424694f50518f68cf95d]) successfully deleted
I20260812 01:14:34.272998 31857 catalog_manager.cc:4841] TS b17adc23b5924461bd178b37e9d259e1 (127.17.183.130:39051): tablet 1d16dac00f0c4ed5864e226d84c5e9de (table test-table [id=e3cae8c63ad2424694f50518f68cf95d]) successfully deleted
I20260812 01:14:34.273066 31857 catalog_manager.cc:4841] TS 47f1d42f329d440b9cf33bd525a91414 (127.17.183.129:39805): tablet 1d16dac00f0c4ed5864e226d84c5e9de (table test-table [id=e3cae8c63ad2424694f50518f68cf95d]) successfully deleted
I20260812 01:14:34.273362 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 32017
I20260812 01:14:34.290980 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 32281
I20260812 01:14:34.307072 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 32563
I20260812 01:14:34.323088 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 31826
2026-08-12T01:14:34Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3201 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:34 dist-test-slave-rwrg krb5kdc[588](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:34 dist-test-slave-rwrg krb5kdc[588](info): set up 2 sockets
Aug 12 01:14:34 dist-test-slave-rwrg krb5kdc[588](info): commencing operation
krb5kdc: starting...
W20260812 01:14:35.652849 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:35 dist-test-slave-rwrg krb5kdc[588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:14:35.777343 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44201
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:35175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:44201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:35.860549 610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:35.860801 610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:35.860839 610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:35.862087 610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:35.862162 610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:35.862188 610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:35.862210 610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:35.862248 610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:35.863751 610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:44201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:35.864039 610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:35.864281 610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:35.869093 617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:35.869100 623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:35.869421 610 server_base.cc:1034] running on GCE node
W20260812 01:14:35.869100 619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:35.869729 610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:35.869990 610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:35.871189 610 hybrid_clock.cc:648] HybridClock initialized: now 1786497275871183 us; error 54 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T01:14:35Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1555 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:35 dist-test-slave-rwrg krb5kdc[640](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:35 dist-test-slave-rwrg krb5kdc[640](info): set up 2 sockets
Aug 12 01:14:35 dist-test-slave-rwrg krb5kdc[640](info): commencing operation
krb5kdc: starting...
W20260812 01:14:37.167665 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:37 dist-test-slave-rwrg krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:14:37.287274 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:40265
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:32871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:40265
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:37.370906 675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:37.371130 675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:37.371153 675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:37.372387 675 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:37.372433 675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:37.372447 675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:37.372484 675 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:37.372532 675 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:37.374023 675 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:32871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:40265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:40265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:37.374269 675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:37.374492 675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:37.379451 681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:37.379422 683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:37.379683 675 server_base.cc:1034] running on GCE node
W20260812 01:14:37.379421 685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:37.380009 675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:37.380344 675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:37.381513 675 hybrid_clock.cc:648] HybridClock initialized: now 1786497277381506 us; error 52 us; skew 500 ppm
Aug 12 01:14:37 dist-test-slave-rwrg krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497277, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:37.384158 675 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:14:37.384634 675 webserver.cc:460] Webserver started at http://127.17.183.190:37649/ using document root <none> and password file <none>
I20260812 01:14:37.384845 675 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:37.384886 675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:37.384975 675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:37.385977 675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "dad81af5e1264166b81843775d6f5ed8"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "34e316565a9cfb21f068f5708c247e3d"
server_key_iv: "1d6d58c9260c216d88920ad6b1e99e35"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.386281 675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "dad81af5e1264166b81843775d6f5ed8"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "34e316565a9cfb21f068f5708c247e3d"
server_key_iv: "1d6d58c9260c216d88920ad6b1e99e35"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.387512 675 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:37.388264 693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:37.388437 675 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:37.388540 675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "dad81af5e1264166b81843775d6f5ed8"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "34e316565a9cfb21f068f5708c247e3d"
server_key_iv: "1d6d58c9260c216d88920ad6b1e99e35"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.388623 675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:37.401347 675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:37.403396 675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:37.403554 675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:37.407649 675 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:40265
I20260812 01:14:37.407706 794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:40265 every 8 connection(s)
I20260812 01:14:37.408071 675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:37.409067 797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:37.411319 797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8: Bootstrap starting.
I20260812 01:14:37.412010 797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:37.412359 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 675
I20260812 01:14:37.412392 797 log.cc:824] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:37.412494 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:37.412710 18142 external_mini_cluster.cc:1428] Setting key 1ec93c7c70b6d10bda42df5aa60e5417
I20260812 01:14:37.413165 797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8: No bootstrap required, opened a new log
I20260812 01:14:37.415459 797 raft_consensus.cc:348] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } }
I20260812 01:14:37.415591 797 raft_consensus.cc:374] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:37.415613 797 raft_consensus.cc:729] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dad81af5e1264166b81843775d6f5ed8, State: Initialized, Role: FOLLOWER
I20260812 01:14:37.415735 797 consensus_queue.cc:260] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } }
I20260812 01:14:37.415807 797 raft_consensus.cc:388] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:37.415827 797 raft_consensus.cc:482] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:37.415887 797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:37.416440 797 raft_consensus.cc:504] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } }
I20260812 01:14:37.416590 797 leader_election.cc:302] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dad81af5e1264166b81843775d6f5ed8; no voters:
I20260812 01:14:37.416770 797 leader_election.cc:288] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:37.416800 804 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:37.417007 804 raft_consensus.cc:686] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 1 LEADER]: Becoming Leader. State: Replica: dad81af5e1264166b81843775d6f5ed8, State: Running, Role: LEADER
I20260812 01:14:37.417145 797 sys_catalog.cc:564] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:37.417156 804 consensus_queue.cc:237] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } }
I20260812 01:14:37.417609 805 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dad81af5e1264166b81843775d6f5ed8. Latest consensus state: current_term: 1 leader_uuid: "dad81af5e1264166b81843775d6f5ed8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } } }
I20260812 01:14:37.417702 805 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:37.417922 809 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dad81af5e1264166b81843775d6f5ed8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } } }
I20260812 01:14:37.418284 809 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:37.418442 818 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:37.419004 818 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 01:14:37 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:37.421170 818 catalog_manager.cc:1347] Generated new cluster ID: afb5a13fbc104e2b86f2243fabb42bb1
I20260812 01:14:37.421257 818 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:37.424651 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:37.413242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37582 (local address 127.17.183.190:40265)
0812 01:14:37.413431 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:37.413439 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:37.413464 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:14:37.414421 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:37.414429 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:37.414479 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:37.414590 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:37.415380 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.416754 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.417750 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.418401 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.418523 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:37.421231 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:37.421235 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:37.421236 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:37.421260 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:37.422983 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:37.423361 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:37.423364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:37.423364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:37.423476 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:37.423691 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:37.423692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:37.423692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:37.423942 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:37.424130 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:37.424210 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 01:14:37.424366 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
I20260812 01:14:37.463172 818 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:37.463917 818 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:37.469257 818 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8: Generated new TSK 0
I20260812 01:14:37.469455 818 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:14:37.506232 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:40265
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:32871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:37.590242 847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:37.590512 847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:37.590559 847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:37.591908 847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:37.591980 847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:37.592028 847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:37.594106 847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:32871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:40265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:37.594393 847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:37.594648 847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:37.599903 855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:37.599820 853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:37.600033 847 server_base.cc:1034] running on GCE node
W20260812 01:14:37.599820 859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:37.600370 847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:37.600713 847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:37.601894 847 hybrid_clock.cc:648] HybridClock initialized: now 1786497277601881 us; error 28 us; skew 500 ppm
Aug 12 01:14:37 dist-test-slave-rwrg krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497277, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:37.604892 847 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:14:37.605337 847 webserver.cc:460] Webserver started at http://127.17.183.129:45445/ using document root <none> and password file <none>
I20260812 01:14:37.605549 847 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:37.605589 847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:37.605723 847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:37.606730 847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "21a3d86be9974274ad6c88af3b1396fe"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "7afc1a384cc9a4eedf6062541272e0c7"
server_key_iv: "c35a0e3a2dc11e48e2ca39373cb0e096"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.607131 847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "21a3d86be9974274ad6c88af3b1396fe"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "7afc1a384cc9a4eedf6062541272e0c7"
server_key_iv: "c35a0e3a2dc11e48e2ca39373cb0e096"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.608359 847 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 01:14:37.609127 874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:37.609319 847 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:37.609411 847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "21a3d86be9974274ad6c88af3b1396fe"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "7afc1a384cc9a4eedf6062541272e0c7"
server_key_iv: "c35a0e3a2dc11e48e2ca39373cb0e096"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.609464 847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:37.622851 847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:37.625000 847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:37.625106 847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:37.625315 847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:37.625586 847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:37.625627 847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:37.625649 847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:37.625661 847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:37.632043 1084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:39733 every 8 connection(s)
I20260812 01:14:37.631969 847 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:39733
I20260812 01:14:37.632573 847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
Aug 12 01:14:37 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497277, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:37.641849 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 847
I20260812 01:14:37.641969 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:37.642266 18142 external_mini_cluster.cc:1428] Setting key 50d6301266e38ec4f54a487e3858caed
I20260812 01:14:37.642302 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:37.633414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:36269 (local address 127.17.183.190:40265)
0812 01:14:37.633529 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:37.633531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:37.633633 (+ 102us) server_negotiation.cc:407] Connection header received
0812 01:14:37.634138 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:37.634139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:37.634150 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:37.634212 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:37.635163 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.635673 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.636789 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.636993 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.637051 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:37.639372 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:37.639373 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:37.639373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:37.639380 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:37.640718 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:37.641122 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:37.641123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:37.641123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:37.641175 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:37.641403 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:37.641404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:37.641404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:37.641507 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:37.641557 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:37.642028 (+ 471us) server_negotiation.cc:299] Negotiation successful
0812 01:14:37.642187 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 01:14:37.642918 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:37.633328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:36269)
0812 01:14:37.633498 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:37.633542 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:37.634034 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:37.634293 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:37.634296 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:37.634851 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:37.635040 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:37.635056 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.635784 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.635785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:37.636703 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:37.636706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.637072 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.637073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:37.637183 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:37.637646 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:37.637655 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:37.639197 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:37.640799 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:37.640807 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:37.640809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:37.641053 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:37.641238 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:37.641239 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:37.641239 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:37.641347 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:37.641597 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:37.641603 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:37.641810 (+ 207us) client_negotiation.cc:769] Sending connection context
0812 01:14:37.642460 (+ 650us) client_negotiation.cc:240] Negotiation successful
0812 01:14:37.642690 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
I20260812 01:14:37.643466 1086 heartbeater.cc:347] Connected to a master server at 127.17.183.190:40265
I20260812 01:14:37.643571 1086 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:37.643767 1086 heartbeater.cc:511] Master 127.17.183.190:40265 requested a full tablet report, sending...
I20260812 01:14:37.644338 725 ts_manager.cc:194] Registered new tserver with Master: 21a3d86be9974274ad6c88af3b1396fe (127.17.183.129:39733)
I20260812 01:14:37.645516 725 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:36269
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:14:37.671226 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:40265
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:32871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:37.758790 1094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:37.758996 1094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:37.759020 1094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:37.760116 1094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:37.760150 1094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:37.760176 1094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:37.761669 1094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:32871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:40265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:37.761874 1094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:37.762072 1094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:37.767031 1102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:37.767098 1105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:37.767093 1103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:37.767467 1094 server_base.cc:1034] running on GCE node
I20260812 01:14:37.767665 1094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:37.767865 1094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:37.769003 1094 hybrid_clock.cc:648] HybridClock initialized: now 1786497277768990 us; error 32 us; skew 500 ppm
Aug 12 01:14:37 dist-test-slave-rwrg krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497277, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:37.771709 1094 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:14:37.772151 1094 webserver.cc:460] Webserver started at http://127.17.183.130:45269/ using document root <none> and password file <none>
I20260812 01:14:37.772344 1094 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:37.772390 1094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:37.772478 1094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:37.773507 1094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "befe2fbb0d5d49b5abfc88f160754267"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "44beb18e28da755b1894690251ddff37"
server_key_iv: "267363e203b955252f57e201ecf26007"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.773802 1094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "befe2fbb0d5d49b5abfc88f160754267"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "44beb18e28da755b1894690251ddff37"
server_key_iv: "267363e203b955252f57e201ecf26007"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.774972 1094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:14:37.775650 1126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:37.775835 1094 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:37.775945 1094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "befe2fbb0d5d49b5abfc88f160754267"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "44beb18e28da755b1894690251ddff37"
server_key_iv: "267363e203b955252f57e201ecf26007"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.776015 1094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:37.784793 1094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:37.786754 1094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:37.786947 1094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:37.787197 1094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:37.787545 1094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:37.787581 1094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:37.787604 1094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:37.787617 1094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:37.793660 1094 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:41847
I20260812 01:14:37.793740 1327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:41847 every 8 connection(s)
I20260812 01:14:37.794054 1094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:37.796664 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 1094
I20260812 01:14:37.796814 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:37.797013 18142 external_mini_cluster.cc:1428] Setting key 6e949ba402f05f7132be43287bf7d51d
Aug 12 01:14:37 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497277, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:37.804302 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:37.794881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:50477 (local address 127.17.183.190:40265)
0812 01:14:37.794946 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:37.794948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:37.795194 (+ 246us) server_negotiation.cc:407] Connection header received
0812 01:14:37.795651 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:37.795652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:37.795663 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:37.795716 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:37.796898 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.797487 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.798923 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.799105 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.799160 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:37.801486 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:37.801487 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:37.801487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:37.801494 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:37.802910 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:37.803313 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:37.803315 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:37.803315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:37.803378 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:37.803633 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:37.803634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:37.803634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:37.803751 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:37.803832 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:37.804130 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 01:14:37.804213 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 01:14:37.804526 1336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:37.794867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:50477)
0812 01:14:37.795072 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:37.795111 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:37.795563 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:37.795776 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:37.795779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:37.796433 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:37.796715 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:37.796721 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.797587 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.797588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:37.798833 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:37.798836 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.799201 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.799202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:37.799338 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:37.799883 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:37.799892 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:37.801390 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:37.803009 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:37.803016 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:37.803019 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:37.803237 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:37.803446 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:37.803447 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:37.803448 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:37.803558 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:37.803836 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:37.803844 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:37.803990 (+ 146us) client_negotiation.cc:769] Sending connection context
0812 01:14:37.804097 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 01:14:37.804248 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":115,"threads_started":1}
I20260812 01:14:37.805076 1331 heartbeater.cc:347] Connected to a master server at 127.17.183.190:40265
I20260812 01:14:37.805182 1331 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:37.805351 1331 heartbeater.cc:511] Master 127.17.183.190:40265 requested a full tablet report, sending...
I20260812 01:14:37.805768 725 ts_manager.cc:194] Registered new tserver with Master: befe2fbb0d5d49b5abfc88f160754267 (127.17.183.130:41847)
I20260812 01:14:37.806337 725 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:50477
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:14:37.825487 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:40265
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:32871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:37.909762 1342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:37.909972 1342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:37.909996 1342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:37.911199 1342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:37.911247 1342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:37.911273 1342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:37.912882 1342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:32871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:40265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:37.913203 1342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:37.913496 1342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:37.918844 1357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:37.918836 1362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:37.918851 1356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:37.919392 1342 server_base.cc:1034] running on GCE node
I20260812 01:14:37.919600 1342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:37.919857 1342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:37.921005 1342 hybrid_clock.cc:648] HybridClock initialized: now 1786497277920977 us; error 41 us; skew 500 ppm
Aug 12 01:14:37 dist-test-slave-rwrg krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497277, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:37.923625 1342 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:14:37.924113 1342 webserver.cc:460] Webserver started at http://127.17.183.131:46257/ using document root <none> and password file <none>
I20260812 01:14:37.924366 1342 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:37.924429 1342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:37.924638 1342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:37.925684 1342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "b6a78e19c25148c891fca0795b898fb7"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "37b5fde9b989ba463bbde517ebd4e75c"
server_key_iv: "a9f1b063f4c64407f917a3392ecfa345"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.926057 1342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "b6a78e19c25148c891fca0795b898fb7"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "37b5fde9b989ba463bbde517ebd4e75c"
server_key_iv: "a9f1b063f4c64407f917a3392ecfa345"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.927423 1342 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:37.928184 1376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:37.928376 1342 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:37.928463 1342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "b6a78e19c25148c891fca0795b898fb7"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "37b5fde9b989ba463bbde517ebd4e75c"
server_key_iv: "a9f1b063f4c64407f917a3392ecfa345"
server_key_version: "encryptionkey@0"
I20260812 01:14:37.928565 1342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:37.942605 1342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:37.944401 1342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:37.944581 1342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:37.944785 1342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:37.945103 1342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:37.945138 1342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:37.945159 1342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:37.945171 1342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:37.950954 1342 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:46781
I20260812 01:14:37.951062 1605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:46781 every 8 connection(s)
I20260812 01:14:37.951362 1342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
Aug 12 01:14:37 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497277, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:37.960220 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:37.952203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:47437 (local address 127.17.183.190:40265)
0812 01:14:37.952271 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:37.952272 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:37.952465 (+ 193us) server_negotiation.cc:407] Connection header received
0812 01:14:37.952983 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:37.952985 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:37.952994 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:37.953048 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:37.953951 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.954431 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.955364 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.955538 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.955587 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:37.957835 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:37.957836 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:37.957836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:37.957843 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:37.959048 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:37.959425 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:37.959426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:37.959426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:37.959475 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:37.959683 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:37.959684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:37.959684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:37.959785 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:37.959831 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:37.960095 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 01:14:37.960157 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 01:14:37.960388 1611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:37.952158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:47437)
0812 01:14:37.952336 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:37.952378 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:37.952897 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:37.953108 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:37.953111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:37.953675 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:37.953874 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:37.953879 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.954513 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.954514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:37.955290 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:37.955293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:37.955612 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:37.955613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:37.955711 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:37.956243 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:37.956252 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:37.957705 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:37.959128 (+ 1423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:37.959136 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:37.959137 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:37.959360 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:37.959533 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:37.959534 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:37.959534 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:37.959631 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:37.959840 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:37.959845 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:37.959953 (+ 108us) client_negotiation.cc:769] Sending connection context
0812 01:14:37.960058 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 01:14:37.960177 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
I20260812 01:14:37.961041 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 1342
I20260812 01:14:37.961048 1609 heartbeater.cc:347] Connected to a master server at 127.17.183.190:40265
I20260812 01:14:37.961156 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:37.961176 1609 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:37.961347 18142 external_mini_cluster.cc:1428] Setting key 1d9fd7c393a3906c1197cf3dc1fecd76
I20260812 01:14:37.961375 1609 heartbeater.cc:511] Master 127.17.183.190:40265 requested a full tablet report, sending...
I20260812 01:14:37.961760 724 ts_manager.cc:194] Registered new tserver with Master: b6a78e19c25148c891fca0795b898fb7 (127.17.183.131:46781)
I20260812 01:14:37.962251 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:14:37.962255 724 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:47437
WARNING: no policy specified for oryx/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab.
Entry for principal oryx/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab.
WARNING: no policy specified for oryx/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab.
Entry for principal oryx/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab.
WARNING: no policy specified for oryx/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab.
Entry for principal oryx/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab.
I20260812 01:14:38.031338 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 847
I20260812 01:14:38.046234 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 1094
I20260812 01:14:38.055406 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 1342
I20260812 01:14:38.068050 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 675
I20260812 01:14:38.081647 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:40265
--webserver_interface=127.17.183.190
--webserver_port=37649
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:32871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:40265
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:38.165527 1626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:38.165725 1626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:38.165747 1626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:38.166918 1626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:38.166961 1626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:38.166976 1626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:38.166988 1626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:38.167065 1626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:38.168527 1626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:32871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:40265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:40265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=37649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:38.168771 1626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:38.169004 1626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:38.174127 1642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:38.174269 1626 server_base.cc:1034] running on GCE node
W20260812 01:14:38.174130 1640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:38.174211 1639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:38.174618 1626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:38.174939 1626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:38.176080 1626 hybrid_clock.cc:648] HybridClock initialized: now 1786497278176062 us; error 40 us; skew 500 ppm
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497278, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:38.178637 1626 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:14:38.179086 1626 webserver.cc:460] Webserver started at http://127.17.183.190:37649/ using document root <none> and password file <none>
I20260812 01:14:38.179340 1626 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:38.179409 1626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:38.180814 1626 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:38.181609 1653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:38.181793 1626 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:38.181913 1626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "dad81af5e1264166b81843775d6f5ed8"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "34e316565a9cfb21f068f5708c247e3d"
server_key_iv: "1d6d58c9260c216d88920ad6b1e99e35"
server_key_version: "encryptionkey@0"
I20260812 01:14:38.182264 1626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:38.194429 1626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:38.196233 1626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:38.196419 1626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:38.200712 1626 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:40265
I20260812 01:14:38.200767 1759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:40265 every 8 connection(s)
I20260812 01:14:38.201296 1626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:38.202649 1760 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:14:38.203276 1760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8: Bootstrap starting.
I20260812 01:14:38.207298 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 1626
I20260812 01:14:38.207677 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:39733
--local_ip_for_outbound_sockets=127.17.183.129
--tserver_master_addrs=127.17.183.190:40265
--webserver_port=45445
--webserver_interface=127.17.183.129
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:32871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.183.129
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:14:38.213616 1760 log.cc:824] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:38.215368 1760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:14:38.215654 1760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8: Bootstrap complete.
I20260812 01:14:38.218109 1760 raft_consensus.cc:348] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } }
I20260812 01:14:38.218372 1760 raft_consensus.cc:729] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dad81af5e1264166b81843775d6f5ed8, State: Initialized, Role: FOLLOWER
I20260812 01:14:38.218583 1760 consensus_queue.cc:260] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } }
I20260812 01:14:38.218685 1760 raft_consensus.cc:388] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:38.218742 1760 raft_consensus.cc:482] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:38.218793 1760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:14:38.219785 1760 raft_consensus.cc:504] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } }
I20260812 01:14:38.219911 1760 leader_election.cc:302] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dad81af5e1264166b81843775d6f5ed8; no voters:
I20260812 01:14:38.220130 1760 leader_election.cc:288] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 01:14:38.220167 1772 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 01:14:38.220289 1772 raft_consensus.cc:686] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [term 2 LEADER]: Becoming Leader. State: Replica: dad81af5e1264166b81843775d6f5ed8, State: Running, Role: LEADER
I20260812 01:14:38.220434 1760 sys_catalog.cc:564] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:38.220449 1772 consensus_queue.cc:237] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } }
I20260812 01:14:38.220891 1777 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "dad81af5e1264166b81843775d6f5ed8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } } }
I20260812 01:14:38.220911 1773 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dad81af5e1264166b81843775d6f5ed8. Latest consensus state: current_term: 2 leader_uuid: "dad81af5e1264166b81843775d6f5ed8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad81af5e1264166b81843775d6f5ed8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40265 } } }
I20260812 01:14:38.221009 1777 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:38.221024 1773 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:38.221275 1790 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:38.221889 1790 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:38.222117 1790 catalog_manager.cc:1259] Loaded cluster ID: afb5a13fbc104e2b86f2243fabb42bb1
I20260812 01:14:38.222312 1790 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:38.223492 1790 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:38.223678 1790 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dad81af5e1264166b81843775d6f5ed8: Loaded TSK: 0
I20260812 01:14:38.223906 1790 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 01:14:38.294613 1763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:38.294835 1763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:38.294874 1763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:38.295997 1763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:38.296062 1763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:38.296106 1763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:38.297619 1763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:32871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.129.keytab
--principal=oryx/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:39733
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=45445
--tserver_master_addrs=127.17.183.190:40265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:38.297885 1763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:38.298122 1763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:38.304118 1823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:38.304273 1763 server_base.cc:1034] running on GCE node
W20260812 01:14:38.304356 1822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:38.304136 1826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:38.304662 1763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:38.304908 1763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:38.306149 1763 hybrid_clock.cc:648] HybridClock initialized: now 1786497278306133 us; error 32 us; skew 500 ppm
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497278, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:38.308714 1763 init.cc:377] Logged in from keytab as oryx/127.17.183.129@KRBTEST.COM (short username oryx)
I20260812 01:14:38.309131 1763 webserver.cc:460] Webserver started at http://127.17.183.129:45445/ using document root <none> and password file <none>
I20260812 01:14:38.309432 1763 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:38.309520 1763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:38.310925 1763 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:38.311597 1839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:38.311825 1763 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:38.311957 1763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "21a3d86be9974274ad6c88af3b1396fe"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "7afc1a384cc9a4eedf6062541272e0c7"
server_key_iv: "c35a0e3a2dc11e48e2ca39373cb0e096"
server_key_version: "encryptionkey@0"
I20260812 01:14:38.312323 1763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:38.322316 1763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:38.324867 1763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:38.325029 1763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:38.325273 1763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:38.325598 1763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:38.325651 1763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:38.325704 1763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:38.325730 1763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:38.331737 1763 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:39733
I20260812 01:14:38.331790 2067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:39733 every 8 connection(s)
I20260812 01:14:38.332150 1763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:14:38.333964 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 1763
I20260812 01:14:38.334296 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:41847
--local_ip_for_outbound_sockets=127.17.183.130
--tserver_master_addrs=127.17.183.190:40265
--webserver_port=45269
--webserver_interface=127.17.183.130
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:32871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.183.130
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:38.341390 2073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:38.332938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:52841)
0812 01:14:38.333147 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:38.333196 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:38.333836 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:38.334365 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:38.334369 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:38.335095 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:38.335352 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.335358 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.336732 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.336734 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.337531 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.337534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.338158 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.338160 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.338282 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.338828 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:38.338836 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:38.341165 (+ 2329us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":102,"threads_started":1}
W20260812 01:14:38.341504 2074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:38.333061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:52841 (local address 127.17.183.190:40265)
0812 01:14:38.333219 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:38.333226 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:38.333281 (+ 55us) server_negotiation.cc:407] Connection header received
0812 01:14:38.334065 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:38.334074 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:38.334160 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:38.334308 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:38.335484 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.336618 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.337651 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.338045 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.338166 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.341312 (+ 3146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:52841: BlockingRecv error: recv got EOF from 127.17.183.129:52841 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
W20260812 01:14:38.341928 2068 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:40265 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.183.190:40265: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:38.346405 2073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:38.342141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:46239)
0812 01:14:38.342290 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:38.342299 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:38.342345 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:38.342485 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:38.342485 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:38.342621 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:38.342661 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.342662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.343291 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.343292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.343779 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.343780 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.344131 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.344132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.344198 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.344666 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:38.344671 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:38.346328 (+ 1657us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104}
W20260812 01:14:38.346457 2074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:38.342224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:46239 (local address 127.17.183.190:40265)
0812 01:14:38.342261 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:38.342263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:38.342352 (+ 89us) server_negotiation.cc:407] Connection header received
0812 01:14:38.342399 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:38.342400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:38.342410 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:38.342482 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:38.342736 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.343200 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.343862 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.344042 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.344129 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.346398 (+ 2269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:46239: BlockingRecv error: recv got EOF from 127.17.183.129:46239 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:38.350939 2073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:38.346872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:35711)
0812 01:14:38.346952 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:38.346962 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:38.347007 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:38.347132 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:38.347134 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:38.347255 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:38.347279 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.347280 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.347924 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.347925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.348405 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.348407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.348780 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.348781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.348833 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.349238 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:38.349243 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:38.350862 (+ 1619us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":66}
W20260812 01:14:38.350987 2074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:38.346918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:35711 (local address 127.17.183.190:40265)
0812 01:14:38.346952 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:38.346954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:38.346993 (+ 39us) server_negotiation.cc:407] Connection header received
0812 01:14:38.347061 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:38.347063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:38.347072 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:38.347120 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:38.347363 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.347820 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.348520 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.348706 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.348781 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.350926 (+ 2145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:35711: BlockingRecv error: recv got EOF from 127.17.183.129:35711 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260812 01:14:38.351296 2068 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 01:14:38.427915 2076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:38.428105 2076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:38.428128 2076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:38.429243 2076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:38.429298 2076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:38.429324 2076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:38.430667 2076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:32871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.130.keytab
--principal=oryx/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:41847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=45269
--tserver_master_addrs=127.17.183.190:40265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:38.430847 2076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:38.431017 2076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:38.436162 2085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:38.436183 2076 server_base.cc:1034] running on GCE node
W20260812 01:14:38.436151 2086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:38.436148 2089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:38.436677 2076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:38.436967 2076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:38.438145 2076 hybrid_clock.cc:648] HybridClock initialized: now 1786497278438126 us; error 32 us; skew 500 ppm
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497278, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:38.440883 2076 init.cc:377] Logged in from keytab as oryx/127.17.183.130@KRBTEST.COM (short username oryx)
I20260812 01:14:38.441329 2076 webserver.cc:460] Webserver started at http://127.17.183.130:45269/ using document root <none> and password file <none>
I20260812 01:14:38.441558 2076 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:38.441640 2076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:38.443074 2076 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:38.443681 2104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:38.443856 2076 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:38.443962 2076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "befe2fbb0d5d49b5abfc88f160754267"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "44beb18e28da755b1894690251ddff37"
server_key_iv: "267363e203b955252f57e201ecf26007"
server_key_version: "encryptionkey@0"
I20260812 01:14:38.444291 2076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:38.451212 2076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:38.453866 2076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:38.454031 2076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:38.454272 2076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:38.454581 2076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:38.454635 2076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:38.454682 2076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:38.454705 2076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:38.460908 2076 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:41847
I20260812 01:14:38.461000 2350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:41847 every 8 connection(s)
I20260812 01:14:38.461315 2076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:38.462435 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 2076
I20260812 01:14:38.462764 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:46781
--local_ip_for_outbound_sockets=127.17.183.131
--tserver_master_addrs=127.17.183.190:40265
--webserver_port=46257
--webserver_interface=127.17.183.131
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:32871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.183.131
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:38.470185 2354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:38.462101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:39111)
0812 01:14:38.462308 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:38.462358 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:38.463139 (+ 781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:38.463393 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:38.463398 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:38.464251 (+ 853us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:38.464560 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.464567 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.465655 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.465656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.466460 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.466462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.467006 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.467007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.467108 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.467635 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:38.467662 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:38.470041 (+ 2379us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":105,"threads_started":1}
W20260812 01:14:38.470248 2074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:38.462134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:39111 (local address 127.17.183.190:40265)
0812 01:14:38.462219 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:38.462221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:38.462489 (+ 268us) server_negotiation.cc:407] Connection header received
0812 01:14:38.463249 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:38.463250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:38.463264 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:38.463318 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:38.464673 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.465468 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.466562 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.466910 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.466983 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.470164 (+ 3181us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:39111: BlockingRecv error: recv got EOF from 127.17.183.130:39111 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260812 01:14:38.470429 2351 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:40265 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.183.190:40265: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:38.475323 2354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:38.470680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:56247)
0812 01:14:38.470784 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:38.470794 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:38.470840 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:38.470975 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:38.470975 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:38.471087 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:38.471131 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.471132 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.472048 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.472048 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.472574 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.472576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.473040 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.473041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.473085 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.473505 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:38.473510 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:38.475259 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":88}
W20260812 01:14:38.475459 2074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:38.470735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:56247 (local address 127.17.183.190:40265)
0812 01:14:38.470801 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:38.470803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:38.470830 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:14:38.470897 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:38.470898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:38.470909 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:38.470973 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:38.471217 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.471970 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.472651 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.472964 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.473041 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.475395 (+ 2354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:56247: BlockingRecv error: recv got EOF from 127.17.183.130:56247 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:38.480000 2354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:38.475607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:43347)
0812 01:14:38.475662 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:38.475672 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:38.475707 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:38.475863 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:38.475864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:38.475967 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:38.475993 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.475994 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.476925 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.476926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.477392 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.477393 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.477844 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.477844 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.477880 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.478261 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:38.478265 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:38.479934 (+ 1669us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 01:14:38.480114 2074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:38.475695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:43347 (local address 127.17.183.190:40265)
0812 01:14:38.475737 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:38.475739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:38.475765 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:14:38.475785 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:38.475786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:38.475795 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:38.475844 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:38.476063 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.476854 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.477466 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.477773 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.477828 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.480017 (+ 2189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:43347: BlockingRecv error: recv got EOF from 127.17.183.130:43347 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 01:14:38.480139 2351 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 01:14:38.553565 2357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:38.553766 2357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:38.553788 2357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:38.554843 2357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:38.554880 2357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:38.554904 2357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:38.556200 2357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:32871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/krb5kdc/oryx_127.17.183.131.keytab
--principal=oryx/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:46781
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=46257
--tserver_master_addrs=127.17.183.190:40265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:38.556370 2357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:38.556617 2357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 01:14:38.561510 2357 server_base.cc:1034] running on GCE node
W20260812 01:14:38.561462 2370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:38.561491 2362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:38.561462 2365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:38.561854 2357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:38.562124 2357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:38.563294 2357 hybrid_clock.cc:648] HybridClock initialized: now 1786497278563280 us; error 28 us; skew 500 ppm
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497278, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:38.565794 2357 init.cc:377] Logged in from keytab as oryx/127.17.183.131@KRBTEST.COM (short username oryx)
I20260812 01:14:38.566260 2357 webserver.cc:460] Webserver started at http://127.17.183.131:46257/ using document root <none> and password file <none>
I20260812 01:14:38.566483 2357 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:38.566560 2357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:38.567873 2357 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:38.568527 2385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:38.568707 2357 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:38.568804 2357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "b6a78e19c25148c891fca0795b898fb7"
format_stamp: "Formatted at 2026-08-12 01:14:37 on dist-test-slave-rwrg"
server_key: "37b5fde9b989ba463bbde517ebd4e75c"
server_key_iv: "a9f1b063f4c64407f917a3392ecfa345"
server_key_version: "encryptionkey@0"
I20260812 01:14:38.569157 2357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:38.583038 2357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:38.585469 2357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:38.585636 2357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:38.585875 2357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:38.586208 2357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:38.586261 2357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:38.586293 2357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:38.586319 2357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:38.592315 2357 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:46781
I20260812 01:14:38.592423 2594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:46781 every 8 connection(s)
I20260812 01:14:38.592794 2357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:38.599392 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 2357
W20260812 01:14:38.600198 2074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:38.593569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:53003 (local address 127.17.183.190:40265)
0812 01:14:38.593636 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:38.593638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:38.593835 (+ 197us) server_negotiation.cc:407] Connection header received
0812 01:14:38.594356 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:38.594357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:38.594367 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:38.594440 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:38.595420 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.595885 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.596898 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.597071 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.597121 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.600123 (+ 3002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:53003: BlockingRecv error: recv got EOF from 127.17.183.131:53003 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 01:14:38.600565 2598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:38.593523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:53003)
0812 01:14:38.593695 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:38.593739 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:38.594265 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:38.594524 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:38.594527 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:38.595136 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:38.595335 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.595340 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.595969 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.595970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.596824 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.596826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.597143 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.597144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.597243 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.597768 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:38.597776 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:38.600318 (+ 2542us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
W20260812 01:14:38.600842 2595 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:40265 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.183.190:40265: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:38.606041 2598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:38.601143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:36849)
0812 01:14:38.601223 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:38.601236 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:38.601291 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:38.601421 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:38.601421 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:38.601590 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:38.601667 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.601669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.602382 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.602384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.603149 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.603152 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.603602 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.603603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.603684 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.604020 (+ 336us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:38.604026 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:38.605963 (+ 1937us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 01:14:38.606097 2074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:38.601247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:36849 (local address 127.17.183.190:40265)
0812 01:14:38.601290 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:38.601292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:38.601301 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:38.601354 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:38.601355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:38.601365 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:38.601419 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:38.601856 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.602302 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.603233 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.603511 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.603571 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.606037 (+ 2466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:36849: BlockingRecv error: recv got EOF from 127.17.183.131:36849 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 01:14:38.608302 2602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:38.599928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37590 (local address 127.17.183.190:40265)
0812 01:14:38.600044 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:38.600045 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:38.600072 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:14:38.600160 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:38.600160 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:38.600169 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:38.600227 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:38.601029 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.601629 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.602652 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.602845 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.602885 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.604643 (+ 1758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:38.604647 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:38.604648 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:38.604662 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:38.606768 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:38.607147 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:38.607151 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:38.607151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:38.607260 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:38.607503 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:38.607504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:38.607505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:38.607754 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:38.607930 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:38.608056 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 01:14:38.608177 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":66,"threads_started":1}
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:38 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:38.610924 2598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:38.606513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:60481)
0812 01:14:38.606562 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:38.606572 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:38.606608 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:38.606793 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:38.606794 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:38.606909 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:38.606935 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.606936 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.607514 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.607515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.607993 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:38.607994 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.608336 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.608338 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:38.608391 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.608830 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:38.608835 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:38.610844 (+ 2009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 01:14:38.610971 2074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:38.606595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:60481 (local address 127.17.183.190:40265)
0812 01:14:38.606670 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:38.606673 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:38.606681 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:38.606706 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:38.606707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:38.606714 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:38.606772 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:38.607015 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.607435 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.608079 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:38.608262 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:38.608334 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:38.610912 (+ 2578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:60481: BlockingRecv error: recv got EOF from 127.17.183.131:60481 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260812 01:14:38.611238 2595 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 01:14:39 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:39 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:39.356179 2603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:39.351726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:42399)
0812 01:14:39.351883 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:39.351894 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:39.351942 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:39.352102 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:39.352103 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:39.352278 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:39.352326 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:39.352328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.352963 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.352963 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:39.353481 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:39.353483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.353804 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.353804 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:39.353843 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:39.354351 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:39.354356 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:39.356116 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
W20260812 01:14:39.356315 2604 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:39.351782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:42399 (local address 127.17.183.190:40265)
0812 01:14:39.351930 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:39.351931 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:39.351941 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:39.352019 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:39.352020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:39.352029 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:39.352079 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:39.352395 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.352896 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.353555 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.353734 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.353790 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:39.356206 (+ 2416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:42399: BlockingRecv error: recv got EOF from 127.17.183.129:42399 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":80,"threads_started":1}
Aug 12 01:14:39 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:39 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:39.485208 2605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:39.480548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:52099)
0812 01:14:39.480719 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:39.480730 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:39.480796 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:39.480930 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:39.480931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:39.481097 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:39.481149 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:39.481151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.481782 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.481783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:39.482318 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:39.482320 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.482649 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.482650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:39.482690 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:39.483142 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:39.483146 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:39.485094 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":97,"threads_started":1}
W20260812 01:14:39.485245 2604 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:39.480625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:52099 (local address 127.17.183.190:40265)
0812 01:14:39.480689 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:39.480691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:39.480797 (+ 106us) server_negotiation.cc:407] Connection header received
0812 01:14:39.480855 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:39.480856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:39.480866 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:39.480907 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:39.481212 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.481709 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.482392 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.482570 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.482636 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:39.485179 (+ 2543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:52099: BlockingRecv error: recv got EOF from 127.17.183.130:52099 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 01:14:39 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:39 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:39.616866 2608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:39.611672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:38827)
0812 01:14:39.611878 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:39.611893 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:39.611971 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:39.612182 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:39.612184 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:39.612371 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:39.612424 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:39.612426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.613094 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.613095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:39.613648 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:39.613649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.614012 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.614013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:39.614056 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:39.614528 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:39.614532 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:39.616803 (+ 2271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":73,"threads_started":1}
W20260812 01:14:39.616966 2604 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:39.611797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:38827 (local address 127.17.183.190:40265)
0812 01:14:39.611869 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:39.611870 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:39.611964 (+ 94us) server_negotiation.cc:407] Connection header received
0812 01:14:39.612046 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:39.612047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:39.612061 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:39.612124 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:39.612537 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.613014 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.613765 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:39.613945 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:39.613998 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:39.616898 (+ 2900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:38827: BlockingRecv error: recv got EOF from 127.17.183.131:38827 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 01:14:40 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:40 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:40.361188 2610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:40.356678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:36403)
0812 01:14:40.356805 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:40.356816 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:40.356886 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:40.357073 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:40.357074 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:40.357247 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:40.357297 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:40.357299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.357898 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.357899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:40.358405 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:40.358407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.358774 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.358775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:40.358816 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:40.359254 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:40.359258 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:40.361119 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":75,"threads_started":1}
W20260812 01:14:40.361351 2612 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:40.356791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:36403 (local address 127.17.183.190:40265)
0812 01:14:40.356931 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:40.356945 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:40.356953 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:40.356984 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:40.356984 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:40.356993 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:40.357053 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:40.357362 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.357835 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.358478 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.358708 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.358760 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:40.361219 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:36403: BlockingRecv error: recv got EOF from 127.17.183.129:36403 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":95,"threads_started":1}
Aug 12 01:14:40 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:40 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:40.490476 2614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:40.485871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:40959)
0812 01:14:40.486031 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:40.486042 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:40.486105 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:40.486240 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:40.486241 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:40.486415 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:40.486465 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:40.486467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.487142 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.487143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:40.487672 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:40.487674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.488037 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.488038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:40.488100 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:40.488562 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:40.488567 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:40.490417 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
W20260812 01:14:40.490592 2612 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:40.485946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:40959 (local address 127.17.183.190:40265)
0812 01:14:40.486031 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:40.486033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:40.486098 (+ 65us) server_negotiation.cc:407] Connection header received
0812 01:14:40.486164 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:40.486165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:40.486175 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:40.486225 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:40.486551 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.487033 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.487761 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.487952 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.488025 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:40.490517 (+ 2492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:40959: BlockingRecv error: recv got EOF from 127.17.183.130:40959 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 12 01:14:40 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:40 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:40.622192 2615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:40.617300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:47257)
0812 01:14:40.617454 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:40.617468 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:40.617546 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:40.617756 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:40.617758 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:40.617935 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:40.617984 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:40.617986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.618650 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.618651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:40.619135 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:40.619137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.619497 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.619498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:40.619562 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:40.620050 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:40.620054 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:40.622100 (+ 2046us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
W20260812 01:14:40.622242 2612 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:40.617423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:47257 (local address 127.17.183.190:40265)
0812 01:14:40.617491 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:40.617493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:40.617517 (+ 24us) server_negotiation.cc:407] Connection header received
0812 01:14:40.617650 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:40.617652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:40.617666 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:40.617748 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:40.618064 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.618572 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.619217 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:40.619423 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:40.619498 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:40.622195 (+ 2697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:47257: BlockingRecv error: recv got EOF from 127.17.183.131:47257 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 01:14:41 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:41 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:41.370118 2616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:41.361762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:42091)
0812 01:14:41.361937 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:41.361948 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:41.362007 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:41.362139 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:41.362140 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:41.362296 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:41.362346 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:41.362348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.362965 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.362966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:41.363473 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:41.363474 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.363794 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.363795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:41.363840 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:41.368014 (+ 4174us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:41.368020 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:41.370054 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":119,"threads_started":1}
W20260812 01:14:41.370288 2617 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:41.361849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:42091 (local address 127.17.183.190:40265)
0812 01:14:41.361968 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:41.361970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:41.361993 (+ 23us) server_negotiation.cc:407] Connection header received
0812 01:14:41.362064 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:41.362064 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:41.362074 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:41.362123 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:41.362413 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.362893 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.363542 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.363714 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.363779 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:41.370182 (+ 6403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:42091: BlockingRecv error: recv got EOF from 127.17.183.129:42091 (error 108)
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":49,"threads_started":1}
Aug 12 01:14:41 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:41 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:41.496018 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:41.491035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:41827)
0812 01:14:41.491228 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:41.491240 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:41.491342 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:41.491528 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:41.491529 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:41.491717 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:41.491774 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:41.491776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.492442 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.492444 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:41.493090 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:41.493093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.493496 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.493497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:41.493554 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:41.494074 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:41.494087 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:41.495946 (+ 1859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":101,"threads_started":1}
W20260812 01:14:41.496098 2617 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:41.491124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:41827 (local address 127.17.183.190:40265)
0812 01:14:41.491218 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:41.491221 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:41.491327 (+ 106us) server_negotiation.cc:407] Connection header received
0812 01:14:41.491436 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:41.491437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:41.491449 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:41.491521 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:41.491872 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.492361 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.493202 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.493420 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.493497 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:41.496049 (+ 2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:41827: BlockingRecv error: recv got EOF from 127.17.183.130:41827 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 01:14:41 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:41 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:41.627302 2619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:41.622677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:55799)
0812 01:14:41.622827 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:41.622840 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:41.622908 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:41.623066 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:41.623067 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:41.623236 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:41.623282 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:41.623284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.623919 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.623921 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:41.624454 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:41.624455 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.624862 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.624863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:41.624929 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:41.625370 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:41.625375 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:41.627204 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":78,"threads_started":1}
W20260812 01:14:41.627317 2617 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:41.622748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:55799 (local address 127.17.183.190:40265)
0812 01:14:41.622823 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:41.622825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:41.622885 (+ 60us) server_negotiation.cc:407] Connection header received
0812 01:14:41.622969 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:41.622970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:41.622983 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:41.623027 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:41.623356 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.623829 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.624599 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:41.624775 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:41.624859 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:41.627247 (+ 2388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:55799: BlockingRecv error: recv got EOF from 127.17.183.131:55799 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 12 01:14:42 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:42 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:42.375401 2621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:42.370698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:51515)
0812 01:14:42.370843 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:42.370855 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:42.370917 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:42.371072 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:42.371073 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:42.371237 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:42.371291 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:42.371293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.371966 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.371967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:42.372591 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:42.372600 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.372946 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.372947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:42.373035 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:42.373487 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:42.373492 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:42.375342 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
W20260812 01:14:42.375507 2622 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:42.370755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:51515 (local address 127.17.183.190:40265)
0812 01:14:42.370889 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:42.370891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:42.370905 (+ 14us) server_negotiation.cc:407] Connection header received
0812 01:14:42.370977 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:42.370978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:42.370988 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:42.371051 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:42.371354 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.371852 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.372679 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.372874 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.372928 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:42.375426 (+ 2498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:51515: BlockingRecv error: recv got EOF from 127.17.183.129:51515 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
Aug 12 01:14:42 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:42 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:42.501114 2623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:42.496556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:46745)
0812 01:14:42.496722 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:42.496740 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:42.496798 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:42.496930 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:42.496931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:42.497101 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:42.497150 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:42.497152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.497782 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.497783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:42.498313 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:42.498314 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.498656 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.498656 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:42.498700 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:42.499163 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:42.499167 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:42.501055 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":70,"threads_started":1}
W20260812 01:14:42.501250 2622 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:42.496644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:46745 (local address 127.17.183.190:40265)
0812 01:14:42.496708 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:42.496710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:42.496798 (+ 88us) server_negotiation.cc:407] Connection header received
0812 01:14:42.496859 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:42.496860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:42.496871 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:42.496912 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:42.497212 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.497708 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.498390 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.498584 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.498645 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:42.501161 (+ 2516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:46745: BlockingRecv error: recv got EOF from 127.17.183.130:46745 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 01:14:42 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:42 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:42.632845 2625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:42.627978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:53881)
0812 01:14:42.628186 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:42.628198 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:42.628288 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:42.628438 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:42.628439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:42.628687 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:42.628737 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:42.628747 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.629443 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.629444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:42.629987 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:42.629989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.630362 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.630363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:42.630424 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:42.630931 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:42.630936 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:42.632784 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":104,"threads_started":1}
W20260812 01:14:42.632951 2622 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:42.628051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:53881 (local address 127.17.183.190:40265)
0812 01:14:42.628152 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:42.628154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:42.628270 (+ 116us) server_negotiation.cc:407] Connection header received
0812 01:14:42.628343 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:42.628344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:42.628358 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:42.628429 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:42.628833 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.629345 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.630079 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:42.630279 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:42.630363 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:42.632880 (+ 2517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:53881: BlockingRecv error: recv got EOF from 127.17.183.131:53881 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 01:14:43 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:43 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:43.380686 2626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:43.375887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:57759)
0812 01:14:43.376026 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:43.376035 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:43.376101 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:43.376243 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:43.376244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:43.376414 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:43.376485 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:43.376488 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.377187 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.377188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:43.377746 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:43.377747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.378124 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.378125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:43.378173 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:43.378623 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:43.378628 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:43.380623 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":58,"threads_started":1}
W20260812 01:14:43.380841 2627 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:43.375963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:57759 (local address 127.17.183.190:40265)
0812 01:14:43.376104 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:43.376106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:43.376136 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:14:43.376158 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:43.376158 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:43.376169 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:43.376219 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:43.376576 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.377086 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.377850 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.378050 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.378101 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:43.380720 (+ 2619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:57759: BlockingRecv error: recv got EOF from 127.17.183.129:57759 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":85,"threads_started":1}
Aug 12 01:14:43 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:43 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:43.506253 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:43.501702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:45103)
0812 01:14:43.501848 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:43.501859 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:43.501910 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:43.502058 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:43.502059 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:43.502228 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:43.502279 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:43.502280 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.502912 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.502913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:43.503427 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:43.503428 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.503750 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.503751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:43.503791 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:43.504228 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:43.504233 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:43.506194 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
W20260812 01:14:43.506402 2627 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:43.501883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:45103 (local address 127.17.183.190:40265)
0812 01:14:43.501937 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:43.501938 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:43.501946 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:43.501973 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:43.501974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:43.501984 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:43.502038 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:43.502352 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.502844 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.503501 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.503684 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.503734 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:43.506318 (+ 2584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:45103: BlockingRecv error: recv got EOF from 127.17.183.130:45103 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 12 01:14:43 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:43 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:43.638289 2629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:43.633523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:47305)
0812 01:14:43.633670 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:43.633683 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:43.633743 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:43.633910 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:43.633911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:43.634081 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:43.634134 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:43.634136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.634782 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.634782 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:43.635301 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:43.635303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.635621 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.635622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:43.635663 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:43.636265 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:43.636270 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:43.638230 (+ 1960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
W20260812 01:14:43.638479 2627 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:43.633592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:47305 (local address 127.17.183.190:40265)
0812 01:14:43.633731 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:43.633733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:43.633740 (+ 7us) server_negotiation.cc:407] Connection header received
0812 01:14:43.633801 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:43.633802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:43.633815 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:43.633869 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:43.634206 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.634706 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.635387 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:43.635557 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:43.635616 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:43.638385 (+ 2769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:47305: BlockingRecv error: recv got EOF from 127.17.183.131:47305 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 12 01:14:44 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:44 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:44.385882 2631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:44.381220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:45897)
0812 01:14:44.381418 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:44.381433 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:44.381509 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:44.381669 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:44.381670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:44.381844 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:44.381894 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:44.381896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.382533 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.382534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:44.383069 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:44.383071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.383395 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.383395 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:44.383435 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:44.383862 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:44.383866 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:44.385778 (+ 1912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":86,"threads_started":1}
W20260812 01:14:44.385936 2632 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:44.381347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:45897 (local address 127.17.183.190:40265)
0812 01:14:44.381498 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:44.381500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:44.381511 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:14:44.381571 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:44.381572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:44.381583 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:44.381644 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:44.381952 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.382461 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.383141 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.383328 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.383379 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:44.385862 (+ 2483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:45897: BlockingRecv error: recv got EOF from 127.17.183.129:45897 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
Aug 12 01:14:44 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:44 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:44.511633 2633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:44.506924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:39019)
0812 01:14:44.507105 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:44.507117 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:44.507178 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:44.507289 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:44.507289 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:44.507483 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:44.507534 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:44.507536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.508167 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.508168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:44.508782 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:44.508784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.509119 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.509120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:44.509164 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:44.509640 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:44.509645 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:44.511528 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":115,"threads_started":1}
W20260812 01:14:44.511682 2632 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:44.506974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:39019 (local address 127.17.183.190:40265)
0812 01:14:44.507050 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:44.507053 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:44.507180 (+ 127us) server_negotiation.cc:407] Connection header received
0812 01:14:44.507223 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:44.507224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:44.507234 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:44.507283 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:44.507611 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.508095 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.508861 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.509048 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.509105 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:44.511617 (+ 2512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:39019: BlockingRecv error: recv got EOF from 127.17.183.130:39019 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 01:14:44 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:44 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:44.643654 2635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:44.639059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:43883)
0812 01:14:44.639216 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:44.639230 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:44.639291 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:44.639484 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:44.639485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:44.639658 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:44.639708 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:44.639709 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.640382 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.640384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:44.641033 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:44.641035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.641405 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.641407 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:44.641469 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:44.641917 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:44.641921 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:44.643596 (+ 1675us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
W20260812 01:14:44.643805 2632 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:44.639156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:43883 (local address 127.17.183.190:40265)
0812 01:14:44.639267 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:44.639270 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:44.639280 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:44.639351 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:44.639352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:44.639367 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:44.639441 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:44.639795 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.640297 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.641126 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:44.641326 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:44.641407 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:44.643718 (+ 2311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:43883: BlockingRecv error: recv got EOF from 127.17.183.131:43883 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 01:14:45 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:45 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:45.391724 2636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:45.386505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:34379)
0812 01:14:45.386687 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:45.386708 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:45.386780 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:45.386923 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:45.386924 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:45.387093 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:45.387144 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:45.387145 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.387947 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.387948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:45.388485 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:45.388487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.388923 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.388924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:45.388963 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:45.389455 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:45.389459 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:45.391647 (+ 2188us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":94,"threads_started":1}
W20260812 01:14:45.391826 2637 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:45.386567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:34379 (local address 127.17.183.190:40265)
0812 01:14:45.386720 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:45.386722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:45.386762 (+ 40us) server_negotiation.cc:407] Connection header received
0812 01:14:45.386833 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:45.386834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:45.386845 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:45.386903 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:45.387243 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.387828 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.388634 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.388850 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.388909 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:45.391749 (+ 2840us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:34379: BlockingRecv error: recv got EOF from 127.17.183.129:34379 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
Aug 12 01:14:45 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:45 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:45.517089 2640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:45.512109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:58429)
0812 01:14:45.512278 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:45.512289 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:45.512365 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:45.512531 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:45.512532 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:45.512707 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:45.512768 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:45.512770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.513537 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.513538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:45.514062 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:45.514064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.514399 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.514400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:45.514441 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:45.514975 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:45.514980 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:45.517027 (+ 2047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":115,"threads_started":1}
W20260812 01:14:45.517287 2637 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:45.512193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:58429 (local address 127.17.183.190:40265)
0812 01:14:45.512256 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:45.512258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:45.512353 (+ 95us) server_negotiation.cc:407] Connection header received
0812 01:14:45.512453 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:45.512454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:45.512465 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:45.512527 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:45.512860 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.513462 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.514140 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.514327 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.514383 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:45.517142 (+ 2759us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:58429: BlockingRecv error: recv got EOF from 127.17.183.130:58429 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 01:14:45 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:45 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:45.649058 2644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:45.644174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:45721)
0812 01:14:45.644352 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:45.644367 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:45.644456 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:45.644642 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:45.644643 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:45.644824 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:45.644872 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:45.644874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.645565 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.645566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:45.646142 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:45.646144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.646510 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.646511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:45.646570 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:45.647079 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:45.647091 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:45.648997 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":90,"threads_started":1}
W20260812 01:14:45.649278 2637 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:45.644290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:45721 (local address 127.17.183.190:40265)
0812 01:14:45.644379 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:45.644381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:45.644449 (+ 68us) server_negotiation.cc:407] Connection header received
0812 01:14:45.644561 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:45.644562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:45.644576 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:45.644623 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:45.644953 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.645467 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.646256 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:45.646436 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:45.646511 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:45.649182 (+ 2671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:45721: BlockingRecv error: recv got EOF from 127.17.183.131:45721 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 01:14:46 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:46 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:46.400664 2649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:46.392315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:54331)
0812 01:14:46.392474 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:46.392486 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:46.392583 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:46.392744 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:46.392745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:46.392906 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:46.392955 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:46.392957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.393610 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.393611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:46.394140 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:46.394142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.394472 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.394473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:46.394512 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:46.398588 (+ 4076us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:46.398593 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:46.400538 (+ 1945us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
W20260812 01:14:46.400748 2653 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:46.392430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:54331 (local address 127.17.183.190:40265)
0812 01:14:46.392610 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:46.392612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:46.392619 (+ 7us) server_negotiation.cc:407] Connection header received
0812 01:14:46.392642 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:46.392643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:46.392652 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:46.392714 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:46.393023 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.393538 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.394214 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.394404 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.394455 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:46.400673 (+ 6218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:54331: BlockingRecv error: recv got EOF from 127.17.183.129:54331 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":89,"threads_started":1}
Aug 12 01:14:46 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:46 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:46.522464 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:46.517575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:46475)
0812 01:14:46.517757 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:46.517768 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:46.517826 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:46.517956 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:46.517957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:46.518116 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:46.518167 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:46.518168 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.518905 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.518905 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:46.519415 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:46.519416 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.519737 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.519738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:46.519778 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:46.520229 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:46.520234 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:46.522360 (+ 2126us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":114,"threads_started":1}
W20260812 01:14:46.522503 2653 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:46.517648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:46475 (local address 127.17.183.190:40265)
0812 01:14:46.517721 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:46.517723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:46.517825 (+ 102us) server_negotiation.cc:407] Connection header received
0812 01:14:46.517871 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:46.517872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:46.517881 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:46.517938 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:46.518224 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.518837 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.519482 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.519669 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.519718 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:46.522442 (+ 2724us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:46475: BlockingRecv error: recv got EOF from 127.17.183.130:46475 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 01:14:46 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:46 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:46.653918 2659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:46.649513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:49637)
0812 01:14:46.649676 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:46.649687 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:46.649742 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:46.649874 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:46.649875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:46.650040 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:46.650100 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:46.650102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.650736 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.650737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:46.651258 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:46.651259 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.651571 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.651572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:46.651613 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:46.652080 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:46.652084 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:46.653858 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":100,"threads_started":1}
W20260812 01:14:46.654018 2653 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:46.649621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:49637 (local address 127.17.183.190:40265)
0812 01:14:46.649683 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:46.649685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:46.649729 (+ 44us) server_negotiation.cc:407] Connection header received
0812 01:14:46.649787 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:46.649788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:46.649800 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:46.649853 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:46.650168 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.650667 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.651329 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:46.651504 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:46.651553 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:46.653951 (+ 2398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:49637: BlockingRecv error: recv got EOF from 127.17.183.131:49637 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 12 01:14:47 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:47 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:47.406069 2660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:47.401184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:35483)
0812 01:14:47.401386 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:47.401397 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:47.401455 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:47.401593 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:47.401594 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:47.401765 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:47.401816 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:47.401818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.402767 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.402768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:47.403302 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:47.403304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.403621 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.403622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:47.403662 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:47.404116 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:47.404120 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:47.406010 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":122,"threads_started":1}
W20260812 01:14:47.406193 2663 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:47.401289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:35483 (local address 127.17.183.190:40265)
0812 01:14:47.401448 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:47.401450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:47.401461 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:14:47.401497 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:47.401498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:47.401509 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:47.401568 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:47.401897 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.402696 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.403372 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.403558 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.403608 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:47.406108 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:35483: BlockingRecv error: recv got EOF from 127.17.183.129:35483 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":107,"threads_started":1}
Aug 12 01:14:47 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:47 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:47.527325 2664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:47.522911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:44409)
0812 01:14:47.523106 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:47.523116 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:47.523169 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:47.523307 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:47.523308 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:47.523469 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:47.523521 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:47.523523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.524131 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.524132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:47.524656 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:47.524658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.524974 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.524975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:47.525014 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:47.525445 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:47.525449 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:47.527256 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":107,"threads_started":1}
W20260812 01:14:47.527482 2663 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:47.523005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:44409 (local address 127.17.183.190:40265)
0812 01:14:47.523065 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:47.523067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:47.523168 (+ 101us) server_negotiation.cc:407] Connection header received
0812 01:14:47.523224 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:47.523225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:47.523237 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:47.523277 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:47.523582 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.524054 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.524724 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.524907 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.524959 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:47.527401 (+ 2442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:44409: BlockingRecv error: recv got EOF from 127.17.183.130:44409 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 12 01:14:47 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:47 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:47.659183 2666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:47.654434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:44787)
0812 01:14:47.654596 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:47.654606 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:47.654660 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:47.654764 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:47.654765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:47.654920 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:47.654970 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:47.654971 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.655608 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.655609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:47.656112 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:47.656113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.656441 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.656442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:47.656485 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:47.656945 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:47.656949 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:47.659046 (+ 2097us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":114,"threads_started":1}
W20260812 01:14:47.659216 2663 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:47.654485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:44787 (local address 127.17.183.190:40265)
0812 01:14:47.654548 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:47.654550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:47.654660 (+ 110us) server_negotiation.cc:407] Connection header received
0812 01:14:47.654701 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:47.654702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:47.654714 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:47.654758 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:47.655057 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.655528 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.656182 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:47.656373 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:47.656425 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:47.659142 (+ 2717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:44787: BlockingRecv error: recv got EOF from 127.17.183.131:44787 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 01:14:48 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:48 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:48.411504 2667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:48.406615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:56507)
0812 01:14:48.406797 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:48.406808 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:48.406859 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:48.406986 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:48.406986 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:48.407156 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:48.407205 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:48.407206 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.407891 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.407892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:48.408396 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:48.408397 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.408822 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.408823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:48.408866 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:48.409372 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:48.409377 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:48.411392 (+ 2015us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":110,"threads_started":1}
W20260812 01:14:48.411615 2668 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:48.406697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:56507 (local address 127.17.183.190:40265)
0812 01:14:48.406850 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:48.406852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:48.406861 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:48.406907 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:48.406907 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:48.406918 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:48.406982 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:48.407283 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.407817 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.408481 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.408750 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.408810 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:48.411485 (+ 2675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:56507: BlockingRecv error: recv got EOF from 127.17.183.129:56507 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":90,"threads_started":1}
Aug 12 01:14:48 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:48 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:48.532172 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:48.527800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:41385)
0812 01:14:48.527965 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:48.527977 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:48.528037 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:48.528170 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:48.528171 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:48.528344 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:48.528396 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:48.528398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.529031 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.529032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:48.529561 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:48.529562 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.529880 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.529881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:48.529921 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:48.530359 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:48.530364 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:48.532112 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":102,"threads_started":1}
W20260812 01:14:48.532276 2668 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:48.527866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:41385 (local address 127.17.183.190:40265)
0812 01:14:48.527929 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:48.527931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:48.528035 (+ 104us) server_negotiation.cc:407] Connection header received
0812 01:14:48.528088 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:48.528088 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:48.528101 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:48.528150 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:48.528458 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.528961 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.529632 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.529816 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.529866 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:48.532209 (+ 2343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:41385: BlockingRecv error: recv got EOF from 127.17.183.130:41385 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 12 01:14:48 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:48 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:48.664114 2676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:48.659738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:41603)
0812 01:14:48.659916 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:48.659931 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:48.660025 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:48.660162 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:48.660162 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:48.660340 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:48.660391 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:48.660392 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.661036 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.661037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:48.661564 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:48.661566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.661880 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.661881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:48.661923 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:48.662367 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:48.662372 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:48.664053 (+ 1681us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":86,"threads_started":1}
W20260812 01:14:48.664229 2668 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:48.659902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:41603 (local address 127.17.183.190:40265)
0812 01:14:48.659960 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:48.659962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:48.660007 (+ 45us) server_negotiation.cc:407] Connection header received
0812 01:14:48.660069 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:48.660069 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:48.660087 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:48.660141 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:48.660451 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.660969 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.661636 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:48.661813 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:48.661862 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:48.664154 (+ 2292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:41603: BlockingRecv error: recv got EOF from 127.17.183.131:41603 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 12 01:14:49 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:49 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:49.417038 2677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:49.412094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:56017)
0812 01:14:49.412247 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:49.412258 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:49.412309 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:49.412488 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:49.412578 (+ 90us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:49.412762 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:49.412830 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:49.412834 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.413505 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.413506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:49.414059 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:49.414060 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.414414 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.414415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:49.414455 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:49.414879 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:49.414895 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:49.416970 (+ 2075us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
W20260812 01:14:49.417173 2678 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:49.412173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:56017 (local address 127.17.183.190:40265)
0812 01:14:49.412308 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:49.412310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:49.412382 (+ 72us) server_negotiation.cc:407] Connection header received
0812 01:14:49.412406 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:49.412406 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:49.412417 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:49.412468 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:49.412926 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.413429 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.414143 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.414347 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.414396 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:49.417065 (+ 2669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:56017: BlockingRecv error: recv got EOF from 127.17.183.129:56017 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":93,"threads_started":1}
Aug 12 01:14:49 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:49 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:49.537894 2680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:49.532676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:41927)
0812 01:14:49.532833 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:49.532868 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:49.532935 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:49.533110 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:49.533111 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:49.533307 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:49.533356 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:49.533358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.534292 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.534294 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:49.534880 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:49.534883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.535212 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.535213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:49.535257 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:49.535813 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:49.535819 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:49.537779 (+ 1960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":80,"threads_started":1}
W20260812 01:14:49.537961 2678 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:49.532816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:41927 (local address 127.17.183.190:40265)
0812 01:14:49.532898 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:49.532900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:49.532913 (+ 13us) server_negotiation.cc:407] Connection header received
0812 01:14:49.533018 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:49.533019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:49.533037 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:49.533101 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:49.533462 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.534128 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.534964 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.535144 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.535196 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:49.537868 (+ 2672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:41927: BlockingRecv error: recv got EOF from 127.17.183.130:41927 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 12 01:14:49 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:49 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:49.669337 2681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:49.664752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:59875)
0812 01:14:49.664963 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:49.664973 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:49.665031 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:49.665175 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:49.665176 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:49.665348 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:49.665395 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:49.665397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.666027 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.666027 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:49.666538 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:49.666539 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.666848 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.666849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:49.666892 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:49.667319 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:49.667324 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:49.669227 (+ 1903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":133,"threads_started":1}
W20260812 01:14:49.669392 2678 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:49.664862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:59875 (local address 127.17.183.190:40265)
0812 01:14:49.664933 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:49.664935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:49.665032 (+ 97us) server_negotiation.cc:407] Connection header received
0812 01:14:49.665098 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:49.665098 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:49.665110 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:49.665152 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:49.665459 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.665956 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.666612 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:49.666783 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:49.666831 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:49.669345 (+ 2514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:59875: BlockingRecv error: recv got EOF from 127.17.183.131:59875 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 12 01:14:50 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:50 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:50.422395 2682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:50.417524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:36243)
0812 01:14:50.417671 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:50.417682 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:50.417781 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:50.417991 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:50.417991 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:50.418152 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:50.418197 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:50.418199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.418819 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.418819 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:50.419317 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:50.419330 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.419658 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.419659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:50.419716 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:50.420291 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:50.420296 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:50.422287 (+ 1991us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":88,"threads_started":1}
W20260812 01:14:50.422446 2684 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:50.417564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:36243 (local address 127.17.183.190:40265)
0812 01:14:50.417688 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:50.417690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:50.417765 (+ 75us) server_negotiation.cc:407] Connection header received
0812 01:14:50.417879 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:50.417880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:50.417908 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:50.417986 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:50.418254 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.418747 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.419402 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.419595 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.419643 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:50.422377 (+ 2734us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:36243: BlockingRecv error: recv got EOF from 127.17.183.129:36243 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":73,"threads_started":1}
Aug 12 01:14:50 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:50 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:50.543159 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:50.538366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:50567)
0812 01:14:50.538521 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:50.538541 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:50.538601 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:50.538786 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:50.538788 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:50.538960 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:50.539009 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:50.539011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.539837 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.539838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:50.540433 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:50.540435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.540844 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.540845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:50.540886 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:50.541301 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:50.541305 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:50.543099 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":94,"threads_started":1}
W20260812 01:14:50.543264 2684 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:50.538430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:50567 (local address 127.17.183.190:40265)
0812 01:14:50.538497 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:50.538499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:50.538650 (+ 151us) server_negotiation.cc:407] Connection header received
0812 01:14:50.538685 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:50.538686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:50.538697 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:50.538758 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:50.539096 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.539760 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.540544 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.540773 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.540831 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:50.543191 (+ 2360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:50567: BlockingRecv error: recv got EOF from 127.17.183.130:50567 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 12 01:14:50 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:50 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:50.674602 2695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:50.669855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:34113)
0812 01:14:50.670009 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:50.670021 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:50.670080 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:50.670198 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:50.670198 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:50.670374 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:50.670423 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:50.670425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.671116 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.671134 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:50.671677 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:50.671679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.672044 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.672045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:50.672102 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:50.672635 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:50.672640 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:50.674540 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":94,"threads_started":1}
W20260812 01:14:50.674759 2684 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:50.669907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:34113 (local address 127.17.183.190:40265)
0812 01:14:50.669957 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:50.669959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:50.670090 (+ 131us) server_negotiation.cc:407] Connection header received
0812 01:14:50.670119 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:50.670120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:50.670133 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:50.670180 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:50.670486 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.671005 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.671749 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:50.671965 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:50.672025 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:50.674668 (+ 2643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:34113: BlockingRecv error: recv got EOF from 127.17.183.131:34113 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 01:14:51 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:51 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:51.431845 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:51.422852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:39971)
0812 01:14:51.423009 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:51.423021 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:51.423077 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:51.423219 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:51.423220 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:51.423395 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:51.423445 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:51.423447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.424074 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.424075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:51.424618 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:51.424620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.424953 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.424954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:51.424994 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:51.429805 (+ 4811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:51.429810 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:51.431784 (+ 1974us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
W20260812 01:14:51.431972 2698 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:51.422932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:39971 (local address 127.17.183.190:40265)
0812 01:14:51.423079 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:51.423081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:51.423107 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:14:51.423140 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:51.423141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:51.423151 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:51.423200 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:51.423510 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.424007 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.424698 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.424890 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.424936 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:51.431885 (+ 6949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:39971: BlockingRecv error: recv got EOF from 127.17.183.129:39971 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
Aug 12 01:14:51 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:51 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:51.548380 2699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:51.543687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:36223)
0812 01:14:51.543845 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:51.543858 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:51.543931 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:51.544064 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:51.544065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:51.544238 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:51.544287 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:51.544289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.544912 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.544913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:51.545488 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:51.545489 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.545805 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.545806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:51.545844 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:51.546262 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:51.546267 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:51.548320 (+ 2053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":78,"threads_started":1}
W20260812 01:14:51.548604 2698 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:51.543822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:36223 (local address 127.17.183.190:40265)
0812 01:14:51.543885 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:51.543887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:51.543915 (+ 28us) server_negotiation.cc:407] Connection header received
0812 01:14:51.543989 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:51.543990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:51.544001 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:51.544041 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:51.544353 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.544849 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.545561 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.545735 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.545789 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:51.548472 (+ 2683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:36223: BlockingRecv error: recv got EOF from 127.17.183.130:36223 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 01:14:51 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:51 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:51.679898 2700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:51.675133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:56933)
0812 01:14:51.675283 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:51.675294 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:51.675363 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:51.675482 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:51.675482 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:51.675647 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:51.675699 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:51.675701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.676326 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.676327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:51.676962 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:51.676964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.677307 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.677308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:51.677378 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:51.677890 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:51.677895 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:51.679782 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":113,"threads_started":1}
W20260812 01:14:51.679934 2698 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:51.675183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:56933 (local address 127.17.183.190:40265)
0812 01:14:51.675235 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:51.675238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:51.675369 (+ 131us) server_negotiation.cc:407] Connection header received
0812 01:14:51.675413 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:51.675414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:51.675428 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:51.675476 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:51.675761 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.676253 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.677037 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:51.677222 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:51.677305 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:51.679867 (+ 2562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:56933: BlockingRecv error: recv got EOF from 127.17.183.131:56933 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 01:14:52 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:52 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:52.436937 2701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:52.432331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:54267)
0812 01:14:52.432465 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:52.432476 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:52.432575 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:52.432768 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:52.432769 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:52.432937 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:52.432985 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:52.432987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.433658 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.433659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:52.434184 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:52.434186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.434516 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.434516 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:52.434556 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:52.435006 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:52.435011 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:52.436871 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":77,"threads_started":1}
W20260812 01:14:52.437073 2705 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:52.432459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:54267 (local address 127.17.183.190:40265)
0812 01:14:52.432638 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:52.432640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:52.432648 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:14:52.432671 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:52.432672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:52.432683 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:52.432750 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:52.433080 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.433588 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.434262 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.434450 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.434501 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:52.436970 (+ 2469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:54267: BlockingRecv error: recv got EOF from 127.17.183.129:54267 (error 108)
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":114,"threads_started":1}
Aug 12 01:14:52 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:52 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:52.553634 2706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:52.548836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:35025)
0812 01:14:52.549023 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:52.549034 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:52.549097 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:52.549231 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:52.549232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:52.549428 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:52.549479 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:52.549481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.550100 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.550101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:52.550679 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:52.550680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.551016 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.551017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:52.551056 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:52.551485 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:52.551490 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:52.553526 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":124,"threads_started":1}
W20260812 01:14:52.553689 2705 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:52.548891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:35025 (local address 127.17.183.190:40265)
0812 01:14:52.548964 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:52.548967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:52.549095 (+ 128us) server_negotiation.cc:407] Connection header received
0812 01:14:52.549159 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:52.549160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:52.549171 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:52.549216 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:52.549544 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.550032 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.550761 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.550947 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.551004 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:52.553621 (+ 2617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:35025: BlockingRecv error: recv got EOF from 127.17.183.130:35025 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 01:14:52 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:52 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.131@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:52.684947 2709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:52.680410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.131:36043)
0812 01:14:52.680558 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:52.680571 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:52.680656 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:52.680786 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:52.680787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:52.680960 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:52.681014 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:52.681016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.681646 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.681647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:52.682169 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:52.682170 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.682492 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.682493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:52.682534 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:52.682962 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:52.682966 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:52.684889 (+ 1923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
W20260812 01:14:52.685081 2705 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:52.680547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:36043 (local address 127.17.183.190:40265)
0812 01:14:52.680594 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:52.680596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:52.680656 (+ 60us) server_negotiation.cc:407] Connection header received
0812 01:14:52.680712 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:52.680712 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:52.680723 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:52.680764 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:52.681078 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.681578 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.682259 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:52.682429 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:52.682477 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:52.684976 (+ 2499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.131:36043: BlockingRecv error: recv got EOF from 127.17.183.131:36043 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 12 01:14:53 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:53 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.129@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:53.442124 2710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:53.437502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.129:53267)
0812 01:14:53.437667 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:53.437680 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:53.437754 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:53.437895 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:53.437896 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:53.438058 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:53.438117 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:53.438118 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:53.438786 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:53.438787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:53.439313 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:53.439315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:53.439641 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:53.439642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:53.439683 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:53.440165 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:53.440170 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:53.442060 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":78,"threads_started":1}
W20260812 01:14:53.442281 2711 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:53.437558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:53267 (local address 127.17.183.190:40265)
0812 01:14:53.437723 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:53.437725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:53.437745 (+ 20us) server_negotiation.cc:407] Connection header received
0812 01:14:53.437808 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:53.437809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:53.437819 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:53.437875 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:53.438178 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:53.438715 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:53.439385 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:53.439575 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:53.439625 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:53.442179 (+ 2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.129:53267: BlockingRecv error: recv got EOF from 127.17.183.129:53267 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
Aug 12 01:14:53 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:14:53 dist-test-slave-rwrg krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.183.130@KRBTEST.COM for oryx/127.17.183.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:14:53.558913 2713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:53.554195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40265 (local address 127.17.183.130:45797)
0812 01:14:53.554386 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:53.554397 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:53.554451 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:53.554632 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:53.554632 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:53.554811 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:53.554861 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:53.554862 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:53.555512 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:53.555513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:53.556038 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:53.556040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:53.556404 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:53.556405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:53.556458 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:53.556973 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:53.556978 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:53.558856 (+ 1878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.183.190:40265: Server oryx/127.17.183.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":128,"threads_started":1}
W20260812 01:14:53.559077 2711 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:53.554258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:45797 (local address 127.17.183.190:40265)
0812 01:14:53.554361 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:53.554363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:53.554455 (+ 92us) server_negotiation.cc:407] Connection header received
0812 01:14:53.554562 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:53.554563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:53.554576 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:53.554617 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:53.554942 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:53.555425 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:53.556122 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:53.556303 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:53.556360 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:53.558973 (+ 2613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.183.130:45797: BlockingRecv error: recv got EOF from 127.17.183.130:45797 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 01:14:53.607892 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 1763
I20260812 01:14:53.621459 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 2076
I20260812 01:14:53.638307 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 2357
I20260812 01:14:53.647771 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 1626
2026-08-12T01:14:53Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17770 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T01:14:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:53Z Disabled control of system clock
I20260812 01:14:53.685108 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:38855
--webserver_interface=127.17.183.190
--webserver_port=0
--builtin_ntp_servers=127.17.183.148:35151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:38855
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 01:14:53.770743 2720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:53.770964 2720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:53.770984 2720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:53.772215 2720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:53.772271 2720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:53.772284 2720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:53.772297 2720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:53.772310 2720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:53.773751 2720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:38855
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:38855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:53.774037 2720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:53.774371 2720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:53.779655 2733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:53.779713 2730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:53.779729 2720 server_base.cc:1034] running on GCE node
W20260812 01:14:53.779629 2731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:53.780097 2720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:53.780367 2720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:53.781519 2720 hybrid_clock.cc:648] HybridClock initialized: now 1786497293781494 us; error 41 us; skew 500 ppm
I20260812 01:14:53.782761 2720 webserver.cc:460] Webserver started at http://127.17.183.190:41583/ using document root <none> and password file <none>
I20260812 01:14:53.783008 2720 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:53.783066 2720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:53.783200 2720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:53.784291 2720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "911bf3d1f25a493eaedd69a981f4e431"
format_stamp: "Formatted at 2026-08-12 01:14:53 on dist-test-slave-rwrg"
server_key: "9b9da74bc23653a06e2d1275ac12c80c"
server_key_iv: "7d0afec9d316a3d358323cd57df4e27d"
server_key_version: "encryptionkey@0"
I20260812 01:14:53.784691 2720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "911bf3d1f25a493eaedd69a981f4e431"
format_stamp: "Formatted at 2026-08-12 01:14:53 on dist-test-slave-rwrg"
server_key: "9b9da74bc23653a06e2d1275ac12c80c"
server_key_iv: "7d0afec9d316a3d358323cd57df4e27d"
server_key_version: "encryptionkey@0"
I20260812 01:14:53.786041 2720 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:53.787147 2744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:53.787339 2720 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:53.787446 2720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "911bf3d1f25a493eaedd69a981f4e431"
format_stamp: "Formatted at 2026-08-12 01:14:53 on dist-test-slave-rwrg"
server_key: "9b9da74bc23653a06e2d1275ac12c80c"
server_key_iv: "7d0afec9d316a3d358323cd57df4e27d"
server_key_version: "encryptionkey@0"
I20260812 01:14:53.787541 2720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:53.807055 2720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:53.807369 2720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:53.807540 2720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:53.811714 2720 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:38855
I20260812 01:14:53.811756 2855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:38855 every 8 connection(s)
I20260812 01:14:53.812120 2720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:53.812875 2856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:53.815562 2856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431: Bootstrap starting.
I20260812 01:14:53.816176 2856 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:53.816478 2856 log.cc:824] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:53.817171 2856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431: No bootstrap required, opened a new log
I20260812 01:14:53.818859 2856 raft_consensus.cc:348] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911bf3d1f25a493eaedd69a981f4e431" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38855 } }
I20260812 01:14:53.819007 2856 raft_consensus.cc:374] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:53.819029 2856 raft_consensus.cc:729] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911bf3d1f25a493eaedd69a981f4e431, State: Initialized, Role: FOLLOWER
I20260812 01:14:53.819195 2856 consensus_queue.cc:260] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911bf3d1f25a493eaedd69a981f4e431" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38855 } }
I20260812 01:14:53.819268 2856 raft_consensus.cc:388] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:53.819291 2856 raft_consensus.cc:482] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:53.819360 2856 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:53.819728 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 2720
I20260812 01:14:53.819820 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:53.819924 2856 raft_consensus.cc:504] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911bf3d1f25a493eaedd69a981f4e431" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38855 } }
I20260812 01:14:53.820041 2856 leader_election.cc:302] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 911bf3d1f25a493eaedd69a981f4e431; no voters:
I20260812 01:14:53.820096 18142 external_mini_cluster.cc:1428] Setting key b1b78d61e81c798a4407385f8638e226
I20260812 01:14:53.820263 2861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:53.820245 2856 leader_election.cc:288] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:53.820434 2861 raft_consensus.cc:686] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [term 1 LEADER]: Becoming Leader. State: Replica: 911bf3d1f25a493eaedd69a981f4e431, State: Running, Role: LEADER
I20260812 01:14:53.820648 2861 consensus_queue.cc:237] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911bf3d1f25a493eaedd69a981f4e431" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38855 } }
I20260812 01:14:53.820683 2856 sys_catalog.cc:564] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:53.823014 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 911bf3d1f25a493eaedd69a981f4e431. Latest consensus state: current_term: 1 leader_uuid: "911bf3d1f25a493eaedd69a981f4e431" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911bf3d1f25a493eaedd69a981f4e431" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38855 } } }
I20260812 01:14:53.823122 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:53.823681 2863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "911bf3d1f25a493eaedd69a981f4e431" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911bf3d1f25a493eaedd69a981f4e431" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38855 } } }
I20260812 01:14:53.824405 2863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431 [sys.catalog]: This master's current role is: LEADER
W20260812 01:14:53.823942 2882 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:14:53.825194 2882 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:14:53.825285 2888 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:53.825491 2888 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:53.826653 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:53.820908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60754 (local address 127.17.183.190:38855)
0812 01:14:53.821141 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:53.821152 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:53.821196 (+ 44us) server_negotiation.cc:407] Connection header received
0812 01:14:53.821340 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:53.821349 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:53.821432 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:53.821645 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:53.821872 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:53.823320 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:53.824257 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:53.824889 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:53.825018 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:53.825753 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:53.825758 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:53.825758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:53.825940 (+ 182us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:53.825973 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:53.825984 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:53.826071 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:53.826360 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 01:14:53.826441 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":97,"threads_started":1}
I20260812 01:14:53.827684 2888 catalog_manager.cc:1347] Generated new cluster ID: 5126e202a4e747d190b475c5a6c115cf
I20260812 01:14:53.827749 2888 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:53.842442 2888 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:53.843171 2888 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:53.851205 2888 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 911bf3d1f25a493eaedd69a981f4e431: Generated new TSK 0
I20260812 01:14:53.851455 2888 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:14:53.857035 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38855
--builtin_ntp_servers=127.17.183.148:35151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 01:14:53.941777 2893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:53.941999 2893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:53.942035 2893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:53.943166 2893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:53.943204 2893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:53.943228 2893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:53.944586 2893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:53.944819 2893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:53.945128 2893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:53.951294 2909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:53.951313 2923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:53.951313 2926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:53.951615 2893 server_base.cc:1034] running on GCE node
I20260812 01:14:53.951817 2893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:53.952069 2893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:53.953299 2893 hybrid_clock.cc:648] HybridClock initialized: now 1786497293953263 us; error 52 us; skew 500 ppm
I20260812 01:14:53.954576 2893 webserver.cc:460] Webserver started at http://127.17.183.129:42143/ using document root <none> and password file <none>
I20260812 01:14:53.954834 2893 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:53.954909 2893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:53.955067 2893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:53.956154 2893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "3bab032908654a819a800a9c039951d3"
format_stamp: "Formatted at 2026-08-12 01:14:53 on dist-test-slave-rwrg"
server_key: "919c76813e07a2fab8c91d34031942c3"
server_key_iv: "42221c8f1ebb69e09093eddf5f664e4b"
server_key_version: "encryptionkey@0"
I20260812 01:14:53.956558 2893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "3bab032908654a819a800a9c039951d3"
format_stamp: "Formatted at 2026-08-12 01:14:53 on dist-test-slave-rwrg"
server_key: "919c76813e07a2fab8c91d34031942c3"
server_key_iv: "42221c8f1ebb69e09093eddf5f664e4b"
server_key_version: "encryptionkey@0"
I20260812 01:14:53.957866 2893 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:53.958557 2935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:53.958760 2893 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:53.958847 2893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "3bab032908654a819a800a9c039951d3"
format_stamp: "Formatted at 2026-08-12 01:14:53 on dist-test-slave-rwrg"
server_key: "919c76813e07a2fab8c91d34031942c3"
server_key_iv: "42221c8f1ebb69e09093eddf5f664e4b"
server_key_version: "encryptionkey@0"
I20260812 01:14:53.958930 2893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:53.992678 2893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:53.993046 2893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:53.993207 2893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:53.993469 2893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:53.993830 2893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:53.993903 2893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:53.993947 2893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:53.993988 2893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:53.999991 2893 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:38527
I20260812 01:14:54.000061 3154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:38527 every 8 connection(s)
I20260812 01:14:54.000387 2893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:14:54.003113 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 2893
I20260812 01:14:54.003198 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:54.003404 18142 external_mini_cluster.cc:1428] Setting key bbb65cab142d88d092e3371e293368e9
I20260812 01:14:54.004446 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38855
--builtin_ntp_servers=127.17.183.148:35151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 01:14:54.006803 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.001251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:47661 (local address 127.17.183.190:38855)
0812 01:14:54.001324 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:54.001326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:54.001613 (+ 287us) server_negotiation.cc:407] Connection header received
0812 01:14:54.002189 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:54.002190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:54.002205 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:54.002260 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:54.003065 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.003685 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.005149 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.005337 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.005414 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:54.006408 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:54.006410 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:54.006410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:54.006415 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:54.006434 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:54.006440 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:54.006503 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:54.006644 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 01:14:54.006684 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 01:14:54.006916 3162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.001232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:38855 (local address 127.17.183.129:47661)
0812 01:14:54.001450 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:54.001486 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:54.002075 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:54.002347 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:54.002351 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:54.002359 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:54.002944 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:54.002952 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.003806 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.003807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:54.005057 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:54.005062 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.005461 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.005462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:54.005629 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:54.006221 (+ 592us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:54.006221 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:54.006264 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:54.006296 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:54.006561 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:54.006567 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:54.006569 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:14:54.006624 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 01:14:54.006704 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":88,"threads_started":1}
I20260812 01:14:54.007449 3155 heartbeater.cc:347] Connected to a master server at 127.17.183.190:38855
I20260812 01:14:54.007557 3155 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:54.007794 3155 heartbeater.cc:511] Master 127.17.183.190:38855 requested a full tablet report, sending...
I20260812 01:14:54.008342 2779 ts_manager.cc:194] Registered new tserver with Master: 3bab032908654a819a800a9c039951d3 (127.17.183.129:38527)
I20260812 01:14:54.009024 2779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.129:47661
W20260812 01:14:54.092604 3163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:54.092804 3163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:54.092826 3163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:54.094012 3163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:54.094058 3163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:54.094084 3163 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:54.095431 3163 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:54.095690 3163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:54.095995 3163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:54.101228 3173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:54.101269 3172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:54.101253 3178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:54.101488 3163 server_base.cc:1034] running on GCE node
I20260812 01:14:54.101676 3163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:54.101874 3163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:54.103020 3163 hybrid_clock.cc:648] HybridClock initialized: now 1786497294103012 us; error 31 us; skew 500 ppm
I20260812 01:14:54.104589 3163 webserver.cc:460] Webserver started at http://127.17.183.130:46779/ using document root <none> and password file <none>
I20260812 01:14:54.104851 3163 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:54.104899 3163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:54.105054 3163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:54.106127 3163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "72a620a2e7954f4a834daa1fd3c54628"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "a6fae980b40e0acff59079cc70d9b185"
server_key_iv: "74d976d7584666282ad1055622e97f4a"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.106508 3163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "72a620a2e7954f4a834daa1fd3c54628"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "a6fae980b40e0acff59079cc70d9b185"
server_key_iv: "74d976d7584666282ad1055622e97f4a"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.107905 3163 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:54.108688 3191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.108867 3163 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:54.108976 3163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "72a620a2e7954f4a834daa1fd3c54628"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "a6fae980b40e0acff59079cc70d9b185"
server_key_iv: "74d976d7584666282ad1055622e97f4a"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.109054 3163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:54.143266 3163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:54.143627 3163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:54.143791 3163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:54.144047 3163 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:54.144421 3163 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:54.144479 3163 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.144560 3163 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:54.144594 3163 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.150859 3163 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:37027
I20260812 01:14:54.150903 3411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:37027 every 8 connection(s)
I20260812 01:14:54.151263 3163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:54.151652 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 3163
I20260812 01:14:54.151765 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:54.152055 18142 external_mini_cluster.cc:1428] Setting key 8cd0c3aa9e2420e5dfba53e65af39baf
I20260812 01:14:54.153151 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38855
--builtin_ntp_servers=127.17.183.148:35151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 01:14:54.157249 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.152113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:36405 (local address 127.17.183.190:38855)
0812 01:14:54.152192 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:54.152194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:54.152486 (+ 292us) server_negotiation.cc:407] Connection header received
0812 01:14:54.153177 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:54.153178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:54.153187 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:54.153256 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:54.154142 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.154619 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.155734 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.155936 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.156015 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:54.156955 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:54.156956 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:54.156956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:54.156961 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:54.156975 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:54.156980 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:54.157034 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:54.157142 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 01:14:54.157171 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 01:14:54.157462 3414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.152068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:38855 (local address 127.17.183.130:36405)
0812 01:14:54.152331 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:54.152395 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:54.153047 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:54.153332 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:54.153337 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:54.153347 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:54.154039 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:54.154046 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.154726 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.154727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:54.155633 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:54.155635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.156028 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.156030 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:54.156168 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:54.156791 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:54.156792 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:54.156822 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:54.156845 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:54.157037 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:54.157043 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:54.157046 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:54.157130 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 01:14:54.157234 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":99,"threads_started":1}
I20260812 01:14:54.157953 3412 heartbeater.cc:347] Connected to a master server at 127.17.183.190:38855
I20260812 01:14:54.158049 3412 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:54.158253 3412 heartbeater.cc:511] Master 127.17.183.190:38855 requested a full tablet report, sending...
I20260812 01:14:54.158661 2779 ts_manager.cc:194] Registered new tserver with Master: 72a620a2e7954f4a834daa1fd3c54628 (127.17.183.130:37027)
I20260812 01:14:54.159201 2779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.130:36405
W20260812 01:14:54.238363 3415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:54.238582 3415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:54.238605 3415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:54.239705 3415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:54.239738 3415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:54.239763 3415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:54.241117 3415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:54.241317 3415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:54.241573 3415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:54.246472 3428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:54.246533 3423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:54.246474 3425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:54.246757 3415 server_base.cc:1034] running on GCE node
I20260812 01:14:54.247004 3415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:54.247231 3415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:54.248399 3415 hybrid_clock.cc:648] HybridClock initialized: now 1786497294248371 us; error 43 us; skew 500 ppm
I20260812 01:14:54.249810 3415 webserver.cc:460] Webserver started at http://127.17.183.131:34565/ using document root <none> and password file <none>
I20260812 01:14:54.250061 3415 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:54.250135 3415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:54.250283 3415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:54.251360 3415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "9588457e78fb454b8d48638b71304a0f"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "05c593949a80ab126f7742c8c7e28d6a"
server_key_iv: "7787691d0c7bca3510153a01bcfd6cbd"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.251734 3415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "9588457e78fb454b8d48638b71304a0f"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "05c593949a80ab126f7742c8c7e28d6a"
server_key_iv: "7787691d0c7bca3510153a01bcfd6cbd"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.253140 3415 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:54.253856 3442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.254029 3415 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:54.254135 3415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "9588457e78fb454b8d48638b71304a0f"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "05c593949a80ab126f7742c8c7e28d6a"
server_key_iv: "7787691d0c7bca3510153a01bcfd6cbd"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.254211 3415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:54.289983 3415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:54.290364 3415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:54.290540 3415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:54.290823 3415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:54.291206 3415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:54.291266 3415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.291308 3415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:54.291335 3415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.297641 3415 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:44451
I20260812 01:14:54.297727 3669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:44451 every 8 connection(s)
I20260812 01:14:54.298089 3415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:54.299255 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 3415
I20260812 01:14:54.299355 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:54.299533 18142 external_mini_cluster.cc:1428] Setting key 2fefb9beb0aa8138455d68e2edc8a740
I20260812 01:14:54.303687 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.298856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:49517 (local address 127.17.183.190:38855)
0812 01:14:54.298903 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:54.298905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:54.299177 (+ 272us) server_negotiation.cc:407] Connection header received
0812 01:14:54.299827 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:54.299828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:54.299842 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:54.299892 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:54.300709 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.301221 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.302223 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.302427 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.302504 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:54.303409 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:54.303410 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:54.303410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:54.303415 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:54.303429 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:54.303434 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:54.303491 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:54.303579 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 01:14:54.303610 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:14:54.303903 3673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.298821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:38855 (local address 127.17.183.131:49517)
0812 01:14:54.299033 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:54.299073 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:54.299715 (+ 642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:54.300035 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:54.300038 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:54.300046 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:54.300606 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:54.300617 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.301319 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.301321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:54.302115 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:54.302117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:54.302513 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:54.302514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:54.302661 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:54.303238 (+ 577us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:54.303238 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:54.303269 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:54.303292 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:54.303503 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:54.303509 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:54.303512 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:54.303581 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 01:14:54.303682 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
I20260812 01:14:54.304401 3670 heartbeater.cc:347] Connected to a master server at 127.17.183.190:38855
I20260812 01:14:54.304478 3670 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:54.304718 3670 heartbeater.cc:511] Master 127.17.183.190:38855 requested a full tablet report, sending...
I20260812 01:14:54.305109 2779 ts_manager.cc:194] Registered new tserver with Master: 9588457e78fb454b8d48638b71304a0f (127.17.183.131:44451)
I20260812 01:14:54.305418 2779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.131:49517
I20260812 01:14:54.311344 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 01:14:54.313390 2865 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:54.312829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39718 (local address 127.17.183.190:38855)
0812 01:14:54.312896 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:54.312898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:54.313061 (+ 163us) server_negotiation.cc:407] Connection header received
0812 01:14:54.313087 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:54.313088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:54.313107 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:54.313168 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:54.313330 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39718: BlockingRecv error: recv got EOF from 127.0.0.1:39718 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 01:14:54.313452 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 2893
I20260812 01:14:54.336586 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 3163
I20260812 01:14:54.354326 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 3415
I20260812 01:14:54.370007 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 2720
2026-08-12T01:14:54Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (720 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T01:14:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:54Z Disabled control of system clock
I20260812 01:14:54.405881 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:39017
--webserver_interface=127.17.183.190
--webserver_port=0
--builtin_ntp_servers=127.17.183.148:37107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:39017
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 01:14:54.487244 3697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:54.487473 3697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:54.487493 3697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:54.488672 3697 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:54.488711 3697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:54.488729 3697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:54.488741 3697 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:54.488795 3697 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:54.490190 3697 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:39017
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:39017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:54.490432 3697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:54.490746 3697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:54.495525 3705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:54.495556 3708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:54.495525 3706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:54.495831 3697 server_base.cc:1034] running on GCE node
I20260812 01:14:54.496084 3697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:54.496322 3697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:54.497628 3697 hybrid_clock.cc:648] HybridClock initialized: now 1786497294497603 us; error 58 us; skew 500 ppm
I20260812 01:14:54.498898 3697 webserver.cc:460] Webserver started at http://127.17.183.190:43679/ using document root <none> and password file <none>
I20260812 01:14:54.499125 3697 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:54.499172 3697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:54.499341 3697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:54.500443 3697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "5657db79ae2042329f8d6d77b35c3b72"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "349634d1238a025bb2147fb16e724405"
server_key_iv: "b0603bdc2fd947aa7db4ba8bd0cb3c1a"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.500862 3697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "5657db79ae2042329f8d6d77b35c3b72"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "349634d1238a025bb2147fb16e724405"
server_key_iv: "b0603bdc2fd947aa7db4ba8bd0cb3c1a"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.502122 3697 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:54.502802 3717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.502977 3697 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:54.503087 3697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "5657db79ae2042329f8d6d77b35c3b72"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "349634d1238a025bb2147fb16e724405"
server_key_iv: "b0603bdc2fd947aa7db4ba8bd0cb3c1a"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.503163 3697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:54.506469 3697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:54.506729 3697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:54.506876 3697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:54.510941 3697 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:39017
I20260812 01:14:54.510974 3821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:39017 every 8 connection(s)
I20260812 01:14:54.511291 3697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:54.511974 3822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:54.514941 3822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72: Bootstrap starting.
I20260812 01:14:54.515523 3822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:54.515834 3822 log.cc:824] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:54.516539 3822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72: No bootstrap required, opened a new log
I20260812 01:14:54.518100 3822 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5657db79ae2042329f8d6d77b35c3b72" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39017 } }
I20260812 01:14:54.518234 3822 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:54.518294 3822 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5657db79ae2042329f8d6d77b35c3b72, State: Initialized, Role: FOLLOWER
I20260812 01:14:54.518436 3822 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5657db79ae2042329f8d6d77b35c3b72" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39017 } }
I20260812 01:14:54.518496 3822 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:54.518517 3822 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:54.518585 3822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:54.519098 3822 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5657db79ae2042329f8d6d77b35c3b72" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39017 } }
I20260812 01:14:54.519212 3822 leader_election.cc:302] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5657db79ae2042329f8d6d77b35c3b72; no voters:
I20260812 01:14:54.519393 3822 leader_election.cc:288] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:54.519438 3830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:54.519623 3830 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [term 1 LEADER]: Becoming Leader. State: Replica: 5657db79ae2042329f8d6d77b35c3b72, State: Running, Role: LEADER
I20260812 01:14:54.519645 3822 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:54.519713 3830 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5657db79ae2042329f8d6d77b35c3b72" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39017 } }
I20260812 01:14:54.520095 3831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5657db79ae2042329f8d6d77b35c3b72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5657db79ae2042329f8d6d77b35c3b72" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39017 } } }
I20260812 01:14:54.520222 3831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:54.520332 3833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5657db79ae2042329f8d6d77b35c3b72. Latest consensus state: current_term: 1 leader_uuid: "5657db79ae2042329f8d6d77b35c3b72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5657db79ae2042329f8d6d77b35c3b72" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39017 } } }
I20260812 01:14:54.520470 3833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72 [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:54.520486 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 3697
I20260812 01:14:54.520506 3845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:54.520617 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:54.520828 18142 external_mini_cluster.cc:1428] Setting key 1ebc1efb09a02871983e559b44586e2f
I20260812 01:14:54.521193 3845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:54.523203 3866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.521466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39972 (local address 127.17.183.190:39017)
0812 01:14:54.521779 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:54.521788 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:54.521826 (+ 38us) server_negotiation.cc:407] Connection header received
0812 01:14:54.521916 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:54.521921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:54.521953 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:54.522094 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:54.522788 (+ 694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:54.522791 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:54.522791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:54.522796 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:54.522836 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:54.522847 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:54.522917 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:54.522997 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 01:14:54.523055 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":68,"threads_started":1}
I20260812 01:14:54.525449 3845 catalog_manager.cc:1347] Generated new cluster ID: 39e1ca4d95894faf9e631334c06eefa1
I20260812 01:14:54.525506 3845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:14:54.540066 3845 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:54.540235 3845 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:54.546027 3845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5657db79ae2042329f8d6d77b35c3b72: Generated new TSK 0
I20260812 01:14:54.546229 3845 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:14:54.548813 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39017
--builtin_ntp_servers=127.17.183.148:37107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 01:14:54.632459 3871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:54.632691 3871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:54.632719 3871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:54.633903 3871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:54.633940 3871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:54.633967 3871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:54.635277 3871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:54.635557 3871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:54.635875 3871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:54.640802 3881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:54.640847 3885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:54.640887 3888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:54.641314 3871 server_base.cc:1034] running on GCE node
I20260812 01:14:54.641508 3871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:54.641752 3871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:54.642923 3871 hybrid_clock.cc:648] HybridClock initialized: now 1786497294642909 us; error 29 us; skew 500 ppm
I20260812 01:14:54.644305 3871 webserver.cc:460] Webserver started at http://127.17.183.129:39929/ using document root <none> and password file <none>
I20260812 01:14:54.644610 3871 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:54.644680 3871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:54.644850 3871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:54.645939 3871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "c27aa19f2cbd4c14b9ef6c11ca2b76a5"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "6400ccc3f36412755782c3884687abee"
server_key_iv: "dd0632222eaa1a199e802cf8e70182d9"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.646302 3871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "c27aa19f2cbd4c14b9ef6c11ca2b76a5"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "6400ccc3f36412755782c3884687abee"
server_key_iv: "dd0632222eaa1a199e802cf8e70182d9"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.647624 3871 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:54.648365 3895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.648572 3871 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:54.648674 3871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "c27aa19f2cbd4c14b9ef6c11ca2b76a5"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "6400ccc3f36412755782c3884687abee"
server_key_iv: "dd0632222eaa1a199e802cf8e70182d9"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.648769 3871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:54.652211 3871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:54.652549 3871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:54.652719 3871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:54.652948 3871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:54.653267 3871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:54.653322 3871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.653363 3871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:54.653391 3871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.659459 3871 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:44609
I20260812 01:14:54.659507 4100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:44609 every 8 connection(s)
I20260812 01:14:54.659826 3871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:14:54.662928 3866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.660553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:33593 (local address 127.17.183.190:39017)
0812 01:14:54.660596 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:54.660598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:54.660857 (+ 259us) server_negotiation.cc:407] Connection header received
0812 01:14:54.661411 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:54.661412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:54.661421 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:54.661473 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:54.662626 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:54.662627 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:54.662627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:54.662632 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:54.662647 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:54.662652 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:54.662738 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:54.662839 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 01:14:54.662856 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 01:14:54.663128 4103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.660502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:39017 (local address 127.17.183.129:33593)
0812 01:14:54.660731 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:54.660764 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:54.661292 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:54.661541 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:54.661545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:54.661554 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:54.662470 (+ 916us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:54.662470 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:54.662498 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:54.662526 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:54.662739 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:54.662747 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:54.662751 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:54.662850 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 01:14:54.662912 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260812 01:14:54.663638 4101 heartbeater.cc:347] Connected to a master server at 127.17.183.190:39017
I20260812 01:14:54.663756 4101 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:54.663913 4101 heartbeater.cc:511] Master 127.17.183.190:39017 requested a full tablet report, sending...
I20260812 01:14:54.664374 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 3871
I20260812 01:14:54.664453 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:54.664553 3757 ts_manager.cc:194] Registered new tserver with Master: c27aa19f2cbd4c14b9ef6c11ca2b76a5 (127.17.183.129:44609)
I20260812 01:14:54.664724 18142 external_mini_cluster.cc:1428] Setting key 4e2ae6e9d94e385f7da8e9a26cad81c4
I20260812 01:14:54.665664 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39017
--builtin_ntp_servers=127.17.183.148:37107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 01:14:54.748790 4104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:54.748984 4104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:54.749006 4104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:54.750236 4104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:54.750275 4104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:54.750301 4104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:54.751662 4104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:54.751852 4104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:54.752095 4104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:54.757172 4117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:54.757236 4104 server_base.cc:1034] running on GCE node
W20260812 01:14:54.757200 4119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:54.757200 4121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:54.757831 4104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:54.758104 4104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:54.759266 4104 hybrid_clock.cc:648] HybridClock initialized: now 1786497294759262 us; error 38 us; skew 500 ppm
I20260812 01:14:54.760669 4104 webserver.cc:460] Webserver started at http://127.17.183.130:43251/ using document root <none> and password file <none>
I20260812 01:14:54.760951 4104 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:54.761021 4104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:54.761168 4104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:54.762233 4104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "b665e8f9122b41f3a47ccb108214ff2b"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "c7c6a278082914a7a3024270a9f006f4"
server_key_iv: "47e02674a74e88a305e9d9bf8cf17fef"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.762610 4104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "b665e8f9122b41f3a47ccb108214ff2b"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "c7c6a278082914a7a3024270a9f006f4"
server_key_iv: "47e02674a74e88a305e9d9bf8cf17fef"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.763918 4104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:54.764686 4131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.764868 4104 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:54.764967 4104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "b665e8f9122b41f3a47ccb108214ff2b"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "c7c6a278082914a7a3024270a9f006f4"
server_key_iv: "47e02674a74e88a305e9d9bf8cf17fef"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.765053 4104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:54.768466 4104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:54.768779 4104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:54.768929 4104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:54.769143 4104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:54.769466 4104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:54.769531 4104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.769569 4104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:54.769598 4104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.775847 4104 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:38967
I20260812 01:14:54.775913 4323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:38967 every 8 connection(s)
I20260812 01:14:54.776284 4104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:54.779183 3866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.777051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:59651 (local address 127.17.183.190:39017)
0812 01:14:54.777127 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:54.777128 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:54.777394 (+ 266us) server_negotiation.cc:407] Connection header received
0812 01:14:54.777851 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:54.777852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:54.777857 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:54.777918 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:54.778986 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:54.778987 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:54.778987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:54.778991 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:54.779006 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:54.779010 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:54.779057 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:54.779116 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 01:14:54.779128 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 01:14:54.779403 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.777032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:39017 (local address 127.17.183.130:59651)
0812 01:14:54.777250 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:54.777303 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:54.777749 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:54.777970 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:54.777973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:54.777981 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:54.778842 (+ 861us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:54.778843 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:54.778872 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:54.778901 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:54.779054 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:54.779056 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:54.779058 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:14:54.779109 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 01:14:54.779155 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":108,"threads_started":1}
I20260812 01:14:54.779910 4324 heartbeater.cc:347] Connected to a master server at 127.17.183.190:39017
I20260812 01:14:54.779994 4324 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:54.780158 4324 heartbeater.cc:511] Master 127.17.183.190:39017 requested a full tablet report, sending...
I20260812 01:14:54.780571 3757 ts_manager.cc:194] Registered new tserver with Master: b665e8f9122b41f3a47ccb108214ff2b (127.17.183.130:38967)
I20260812 01:14:54.781226 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 4104
I20260812 01:14:54.781350 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:54.781548 18142 external_mini_cluster.cc:1428] Setting key edec885222033e8d8928685a83da2cde
I20260812 01:14:54.782469 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39017
--builtin_ntp_servers=127.17.183.148:37107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 01:14:54.866884 4330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:54.867147 4330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:54.867188 4330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:54.868438 4330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:54.868505 4330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:54.868573 4330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:54.869944 4330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:39017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:54.870220 4330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:54.870532 4330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:54.875624 4343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:54.875624 4348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:54.875653 4344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:54.875795 4330 server_base.cc:1034] running on GCE node
I20260812 01:14:54.876091 4330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:54.876397 4330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:54.877568 4330 hybrid_clock.cc:648] HybridClock initialized: now 1786497294877561 us; error 37 us; skew 500 ppm
I20260812 01:14:54.878751 4330 webserver.cc:460] Webserver started at http://127.17.183.131:39871/ using document root <none> and password file <none>
I20260812 01:14:54.878986 4330 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:54.879078 4330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:54.879225 4330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:54.880275 4330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "af857af684ca4382aa6183dbd3454858"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "4d257b6c86be0ed744ecc625a9dd510a"
server_key_iv: "12e99f128690ccf2dc152a39b8bf64ff"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.880683 4330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "af857af684ca4382aa6183dbd3454858"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "4d257b6c86be0ed744ecc625a9dd510a"
server_key_iv: "12e99f128690ccf2dc152a39b8bf64ff"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.881999 4330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:14:54.882740 4362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.882911 4330 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:14:54.883035 4330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "af857af684ca4382aa6183dbd3454858"
format_stamp: "Formatted at 2026-08-12 01:14:54 on dist-test-slave-rwrg"
server_key: "4d257b6c86be0ed744ecc625a9dd510a"
server_key_iv: "12e99f128690ccf2dc152a39b8bf64ff"
server_key_version: "encryptionkey@0"
I20260812 01:14:54.883111 4330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:54.886482 4330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:54.886732 4330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:54.886876 4330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:54.887079 4330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:54.887394 4330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:54.887457 4330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.887496 4330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:54.887523 4330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:54.893851 4330 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:41767
I20260812 01:14:54.893900 4586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:41767 every 8 connection(s)
I20260812 01:14:54.894188 4330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:54.897282 3866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.894884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:39169 (local address 127.17.183.190:39017)
0812 01:14:54.894949 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:54.894951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:54.895162 (+ 211us) server_negotiation.cc:407] Connection header received
0812 01:14:54.895651 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:54.895652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:54.895659 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:54.895708 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:54.897012 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:54.897013 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:54.897014 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:14:54.897018 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:54.897035 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:14:54.897039 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:54.897106 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:54.897195 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 01:14:54.897211 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 01:14:54.897478 4589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:54.894862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:39017 (local address 127.17.183.131:39169)
0812 01:14:54.895054 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:54.895086 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:54.895524 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:54.895779 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:54.895782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:54.895790 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:54.896848 (+ 1058us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:14:54.896849 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:54.896876 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:14:54.896903 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:54.897100 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:54.897105 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:54.897108 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:14:54.897205 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 01:14:54.897265 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
I20260812 01:14:54.897848 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 4330
I20260812 01:14:54.897921 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:54.898029 4587 heartbeater.cc:347] Connected to a master server at 127.17.183.190:39017
I20260812 01:14:54.898124 4587 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:54.898167 18142 external_mini_cluster.cc:1428] Setting key 670f5146ac9424fd6ec6ec0f83f77b20
I20260812 01:14:54.898300 4587 heartbeater.cc:511] Master 127.17.183.190:39017 requested a full tablet report, sending...
I20260812 01:14:54.898715 3757 ts_manager.cc:194] Registered new tserver with Master: af857af684ca4382aa6183dbd3454858 (127.17.183.131:41767)
I20260812 01:14:54.899171 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 01:14:54.900868 3866 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:14:54.900419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39988 (local address 127.17.183.190:39017)
0812 01:14:54.900454 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:54.900456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:54.900632 (+ 176us) server_negotiation.cc:407] Connection header received
0812 01:14:54.900677 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:54.900678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:54.900681 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:54.900727 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:54.900825 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39988: BlockingRecv error: recv got EOF from 127.0.0.1:39988 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 01:14:54.901013 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 3871
I20260812 01:14:54.919727 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 4104
I20260812 01:14:54.938026 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 4330
I20260812 01:14:54.948624 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 3697
2026-08-12T01:14:54Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (579 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:55 dist-test-slave-rwrg krb5kdc[4603](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:55 dist-test-slave-rwrg krb5kdc[4603](info): set up 2 sockets
Aug 12 01:14:55 dist-test-slave-rwrg krb5kdc[4603](info): commencing operation
krb5kdc: starting...
W20260812 01:14:56.248473 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:56 dist-test-slave-rwrg krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:14:56.370994 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:36103
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:36103
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:56.453490 4632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:56.453685 4632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:56.453706 4632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:56.454896 4632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:14:56.454938 4632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:56.454953 4632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:56.454998 4632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:14:56.455022 4632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:14:56.456583 4632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:36103
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:36103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:56.456835 4632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:56.457064 4632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:56.461748 4644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:56.461748 4638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:56.461792 4639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:56.461973 4632 server_base.cc:1034] running on GCE node
I20260812 01:14:56.462242 4632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:56.462580 4632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:56.463735 4632 hybrid_clock.cc:648] HybridClock initialized: now 1786497296463721 us; error 28 us; skew 500 ppm
Aug 12 01:14:56 dist-test-slave-rwrg krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497296, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:56.469520 4632 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:14:56.469983 4632 webserver.cc:460] Webserver started at http://127.17.183.190:44313/ using document root <none> and password file <none>
I20260812 01:14:56.470224 4632 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:56.470296 4632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:56.470450 4632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:56.471530 4632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "6bfe9d52bf4249eab81cbd1b31483b9c"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "91944a1d8591e37e63465a124a04ee21"
server_key_iv: "d7b4c609e5507acd26802cf48ce3ede3"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.471911 4632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "6bfe9d52bf4249eab81cbd1b31483b9c"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "91944a1d8591e37e63465a124a04ee21"
server_key_iv: "d7b4c609e5507acd26802cf48ce3ede3"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.473330 4632 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:14:56.474092 4659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:56.474261 4632 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:56.474372 4632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "6bfe9d52bf4249eab81cbd1b31483b9c"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "91944a1d8591e37e63465a124a04ee21"
server_key_iv: "d7b4c609e5507acd26802cf48ce3ede3"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.474448 4632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:56.483714 4632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:56.485570 4632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:56.485733 4632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:56.489854 4632 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:36103
I20260812 01:14:56.489890 4763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:36103 every 8 connection(s)
I20260812 01:14:56.490227 4632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:14:56.491182 4764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:56.493446 4764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c: Bootstrap starting.
I20260812 01:14:56.493960 4764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:56.494213 4764 log.cc:824] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:56.494853 4764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c: No bootstrap required, opened a new log
I20260812 01:14:56.495970 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 4632
I20260812 01:14:56.496094 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:14:56.496294 18142 external_mini_cluster.cc:1428] Setting key bbbe6037afbbc954496c7038602ec40b
I20260812 01:14:56.496687 4764 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bfe9d52bf4249eab81cbd1b31483b9c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36103 } }
I20260812 01:14:56.496865 4764 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:56.496912 4764 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bfe9d52bf4249eab81cbd1b31483b9c, State: Initialized, Role: FOLLOWER
I20260812 01:14:56.497031 4764 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bfe9d52bf4249eab81cbd1b31483b9c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36103 } }
I20260812 01:14:56.497134 4764 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:14:56.497169 4764 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:14:56.497215 4764 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:56.497989 4764 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bfe9d52bf4249eab81cbd1b31483b9c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36103 } }
I20260812 01:14:56.498086 4764 leader_election.cc:302] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6bfe9d52bf4249eab81cbd1b31483b9c; no voters:
I20260812 01:14:56.498245 4764 leader_election.cc:288] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:14:56.498270 4772 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:56.498371 4772 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [term 1 LEADER]: Becoming Leader. State: Replica: 6bfe9d52bf4249eab81cbd1b31483b9c, State: Running, Role: LEADER
I20260812 01:14:56.498450 4772 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bfe9d52bf4249eab81cbd1b31483b9c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36103 } }
I20260812 01:14:56.498504 4764 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:14:56.498787 4772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6bfe9d52bf4249eab81cbd1b31483b9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bfe9d52bf4249eab81cbd1b31483b9c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36103 } } }
I20260812 01:14:56.498852 4772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:56.498971 4772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bfe9d52bf4249eab81cbd1b31483b9c. Latest consensus state: current_term: 1 leader_uuid: "6bfe9d52bf4249eab81cbd1b31483b9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bfe9d52bf4249eab81cbd1b31483b9c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36103 } } }
I20260812 01:14:56.499034 4772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c [sys.catalog]: This master's current role is: LEADER
I20260812 01:14:56.499150 4781 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:14:56.499868 4781 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:14:56.501564 4781 catalog_manager.cc:1347] Generated new cluster ID: 587f4f6d2c664f8689b0f76e5bc65716
I20260812 01:14:56.501621 4781 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:14:56 dist-test-slave-rwrg krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:56.507941 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:56.496869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54694 (local address 127.17.183.190:36103)
0812 01:14:56.497098 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:56.497107 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:56.497141 (+ 34us) server_negotiation.cc:407] Connection header received
0812 01:14:56.497264 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:56.497271 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:56.497325 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:56.497494 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:56.498259 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:56.499698 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:56.500621 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:56.501221 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:56.501387 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:56.504139 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:56.504144 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:56.504145 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:56.504155 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:56.506138 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:56.506535 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:56.506538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:56.506538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:56.506663 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:56.506879 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:56.506880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:56.506881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:56.507234 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:56.507414 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:56.507537 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 01:14:56.507723 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":87,"threads_started":1}
I20260812 01:14:56.520326 4781 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:14:56.521070 4781 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:14:56.527403 4781 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c: Generated new TSK 0
I20260812 01:14:56.527592 4781 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:14:56.555821 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36103
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:56.639839 4810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:56.640034 4810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:56.640056 4810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:56.641315 4810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:56.641373 4810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:56.641402 4810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:14:56.642784 4810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36103
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:56.642957 4810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:56.643138 4810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:56.648223 4818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:56.648275 4810 server_base.cc:1034] running on GCE node
W20260812 01:14:56.648278 4819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:56.648240 4822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:56.648670 4810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:56.648943 4810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:56.650146 4810 hybrid_clock.cc:648] HybridClock initialized: now 1786497296650123 us; error 39 us; skew 500 ppm
Aug 12 01:14:56 dist-test-slave-rwrg krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497296, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:56.652796 4810 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:14:56.653244 4810 webserver.cc:460] Webserver started at http://127.17.183.129:37431/ using document root <none> and password file <none>
I20260812 01:14:56.653478 4810 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:56.653556 4810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:56.653713 4810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:56.654870 4810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "efc05cc517d74b14a38351bb709723cb"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "924ad506e7986df8aea8680564b771c8"
server_key_iv: "b3add9792a38cf2dc9372e538d10a9b2"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.655232 4810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "efc05cc517d74b14a38351bb709723cb"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "924ad506e7986df8aea8680564b771c8"
server_key_iv: "b3add9792a38cf2dc9372e538d10a9b2"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.656675 4810 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:56.657545 4837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:56.657789 4810 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:56.657904 4810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "efc05cc517d74b14a38351bb709723cb"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "924ad506e7986df8aea8680564b771c8"
server_key_iv: "b3add9792a38cf2dc9372e538d10a9b2"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.657999 4810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:56.673125 4810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:56.675242 4810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:56.675422 4810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:56.675688 4810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:56.676023 4810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:56.676086 4810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:56.676134 4810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:56.676162 4810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:56.683038 4810 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:36549
I20260812 01:14:56.683101 5070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:36549 every 8 connection(s)
I20260812 01:14:56.683429 4810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
Aug 12 01:14:56 dist-test-slave-rwrg krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497296, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:56.690909 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 4810
I20260812 01:14:56.691025 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:14:56.691244 18142 external_mini_cluster.cc:1428] Setting key b860ff2ccdb247d28482422f4e9d5be2
I20260812 01:14:56.693756 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:56.684202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:46261 (local address 127.17.183.190:36103)
0812 01:14:56.684352 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:56.684355 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:56.684642 (+ 287us) server_negotiation.cc:407] Connection header received
0812 01:14:56.685163 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:56.685165 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:56.685177 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:56.685235 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:56.686247 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:56.686756 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:56.688309 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:56.688535 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:56.688631 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:56.690754 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:56.690755 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:56.690756 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:56.690763 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:56.692270 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:56.692785 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:56.692785 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:56.692785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:56.692843 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:56.693125 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:56.693126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:56.693126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:56.693220 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:56.693271 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:56.693630 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 01:14:56.693695 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260812 01:14:56.694038 5076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:56.684196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36103 (local address 127.17.183.129:46261)
0812 01:14:56.684423 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:56.684472 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:56.685075 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:56.685294 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:56.685297 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:56.685921 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:56.686160 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:56.686165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:56.686901 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:56.686903 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:56.688219 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:56.688222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:56.688650 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:56.688651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:56.688776 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:56.689222 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:56.689231 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:56.690645 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:56.692351 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:56.692360 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:56.692362 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:56.692700 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:56.692908 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:56.692909 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:56.692909 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:56.693060 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:56.693286 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:56.693293 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:56.693481 (+ 188us) client_negotiation.cc:769] Sending connection context
0812 01:14:56.693596 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 01:14:56.693768 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":128,"threads_started":1}
I20260812 01:14:56.694612 5071 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36103
I20260812 01:14:56.694705 5071 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:56.694908 5071 heartbeater.cc:511] Master 127.17.183.190:36103 requested a full tablet report, sending...
I20260812 01:14:56.695420 4697 ts_manager.cc:194] Registered new tserver with Master: efc05cc517d74b14a38351bb709723cb (127.17.183.129:36549)
I20260812 01:14:56.696060 4697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:46261
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:14:56.719563 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36103
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:56.801748 5080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:56.801934 5080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:56.801956 5080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:56.803066 5080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:56.803105 5080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:56.803131 5080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:14:56.804629 5080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36103
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:56.804852 5080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:56.805080 5080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:56.810107 5091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:56.810093 5087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:56.810075 5093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:56.810161 5080 server_base.cc:1034] running on GCE node
I20260812 01:14:56.810433 5080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:56.810688 5080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:56.811825 5080 hybrid_clock.cc:648] HybridClock initialized: now 1786497296811813 us; error 37 us; skew 500 ppm
Aug 12 01:14:56 dist-test-slave-rwrg krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497296, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:56.814211 5080 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:14:56.814719 5080 webserver.cc:460] Webserver started at http://127.17.183.130:39733/ using document root <none> and password file <none>
I20260812 01:14:56.814963 5080 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:56.815008 5080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:56.815155 5080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:56.816202 5080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "19a6d4f2ab2a4953a6b7e787414eb666"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "7537b700eacfc52467188e9959e7d206"
server_key_iv: "c464c88fef80c9d273038636b90026ad"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.816620 5080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "19a6d4f2ab2a4953a6b7e787414eb666"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "7537b700eacfc52467188e9959e7d206"
server_key_iv: "c464c88fef80c9d273038636b90026ad"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.817930 5080 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:14:56.818665 5101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:56.818851 5080 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:56.818943 5080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "19a6d4f2ab2a4953a6b7e787414eb666"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "7537b700eacfc52467188e9959e7d206"
server_key_iv: "c464c88fef80c9d273038636b90026ad"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.819017 5080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:56.831386 5080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:56.833346 5080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:56.833510 5080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:56.833751 5080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:56.834071 5080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:56.834108 5080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:56.834149 5080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:56.834177 5080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:56.840731 5080 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:43035
I20260812 01:14:56.840781 5312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:43035 every 8 connection(s)
I20260812 01:14:56.841104 5080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:14:56.844990 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 5080
I20260812 01:14:56.845068 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:14:56.845288 18142 external_mini_cluster.cc:1428] Setting key 5f1d9d2ac0e5ef0e4d32a4b373cdf82c
Aug 12 01:14:56 dist-test-slave-rwrg krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497296, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:56.851029 5318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:56.841836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36103 (local address 127.17.183.130:52985)
0812 01:14:56.842016 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:56.842060 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:56.842568 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:56.842799 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:56.842802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:56.843376 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:56.843589 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:56.843594 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:56.844240 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:56.844241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:56.845219 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:56.845223 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:56.845697 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:56.845698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:56.845825 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:56.846373 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:56.846383 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:56.847994 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:56.849615 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:56.849623 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:56.849625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:56.849846 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:56.850060 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:56.850060 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:56.850061 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:56.850186 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:56.850550 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:56.850555 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:56.850679 (+ 124us) client_negotiation.cc:769] Sending connection context
0812 01:14:56.850762 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 01:14:56.850875 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
I20260812 01:14:56.851064 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:56.841856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:52985 (local address 127.17.183.190:36103)
0812 01:14:56.841934 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:56.841936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:56.842150 (+ 214us) server_negotiation.cc:407] Connection header received
0812 01:14:56.842649 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:56.842650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:56.842660 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:56.842736 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:56.843665 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:56.844157 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:56.845306 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:56.845556 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:56.845656 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:56.848118 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:56.848120 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:56.848121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:56.848127 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:56.849523 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:56.849924 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:56.849925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:56.849926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:56.849985 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:56.850287 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:56.850288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:56.850288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:56.850459 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:56.850558 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:56.850815 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 01:14:56.850920 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:14:56.851678 5315 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36103
I20260812 01:14:56.851765 5315 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:56.851969 5315 heartbeater.cc:511] Master 127.17.183.190:36103 requested a full tablet report, sending...
I20260812 01:14:56.852437 4697 ts_manager.cc:194] Registered new tserver with Master: 19a6d4f2ab2a4953a6b7e787414eb666 (127.17.183.130:43035)
I20260812 01:14:56.852957 4697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:52985
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:14:56.871709 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36103
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:14:56.955564 5324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:14:56.955751 5324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:14:56.955773 5324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:14:56.956768 5324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:14:56.956802 5324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:14:56.956825 5324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:14:56.958150 5324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36103
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:14:56.958317 5324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:14:56.958503 5324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:14:56.963551 5331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:56.963608 5333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:14:56.963559 5335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:14:56.963863 5324 server_base.cc:1034] running on GCE node
I20260812 01:14:56.964076 5324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:14:56.964322 5324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:14:56.965488 5324 hybrid_clock.cc:648] HybridClock initialized: now 1786497296965483 us; error 41 us; skew 500 ppm
Aug 12 01:14:56 dist-test-slave-rwrg krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497296, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:14:56.968101 5324 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:14:56.968555 5324 webserver.cc:460] Webserver started at http://127.17.183.131:40911/ using document root <none> and password file <none>
I20260812 01:14:56.968777 5324 fs_manager.cc:359] Metadata directory not provided
I20260812 01:14:56.968842 5324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:14:56.968995 5324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:14:56.970050 5324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "83b79fdd58c8470db37c5bb563f57e02"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "124dac642dfd7c9a74f7ec38c93102eb"
server_key_iv: "cb16a7a0262201f9705df53323284594"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.970408 5324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "83b79fdd58c8470db37c5bb563f57e02"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "124dac642dfd7c9a74f7ec38c93102eb"
server_key_iv: "cb16a7a0262201f9705df53323284594"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.971709 5324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:14:56.972381 5346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:56.972587 5324 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:14:56.972687 5324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "83b79fdd58c8470db37c5bb563f57e02"
format_stamp: "Formatted at 2026-08-12 01:14:56 on dist-test-slave-rwrg"
server_key: "124dac642dfd7c9a74f7ec38c93102eb"
server_key_iv: "cb16a7a0262201f9705df53323284594"
server_key_version: "encryptionkey@0"
I20260812 01:14:56.972774 5324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:14:56.994189 5324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:14:56.996003 5324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:14:56.996167 5324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:14:56.996475 5324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:14:56.996842 5324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:14:56.996901 5324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:56.996942 5324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:14:56.996970 5324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:14:57.003473 5324 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:34047
I20260812 01:14:57.003517 5560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:34047 every 8 connection(s)
I20260812 01:14:57.003840 5324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:14:57.006686 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 5324
I20260812 01:14:57.006814 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:14:57.007012 18142 external_mini_cluster.cc:1428] Setting key 3867864e07d756b05eddc612e31b28c1
Aug 12 01:14:57 dist-test-slave-rwrg krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497296, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:14:57.013621 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.004554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:35845 (local address 127.17.183.190:36103)
0812 01:14:57.004616 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:57.004618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:57.004848 (+ 230us) server_negotiation.cc:407] Connection header received
0812 01:14:57.005437 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:57.005438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:57.005453 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:57.005511 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:57.006489 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.007075 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.008535 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.008726 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.008780 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.011109 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:57.011110 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:57.011110 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:57.011117 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:57.012311 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:57.012793 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:57.012794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:57.012794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:57.012848 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:57.013076 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:57.013077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:57.013077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:57.013180 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:57.013233 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:57.013477 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 01:14:57.013542 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 01:14:57.013796 5564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.004552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36103 (local address 127.17.183.131:35845)
0812 01:14:57.004725 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:57.004763 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:57.005316 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:57.005585 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:57.005590 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:57.006181 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:14:57.006373 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.006378 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.007208 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.007209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.008415 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.008419 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.008802 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.008803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.008910 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.009620 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:14:57.009628 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:14:57.011018 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:14:57.012389 (+ 1371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:57.012396 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:57.012398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:57.012722 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:57.012914 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:14:57.012915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:14:57.012915 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:14:57.013020 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:14:57.013244 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:14:57.013249 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:14:57.013363 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 01:14:57.013447 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 01:14:57.013563 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
I20260812 01:14:57.014308 5562 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36103
I20260812 01:14:57.014390 5562 heartbeater.cc:464] Registering TS with master...
I20260812 01:14:57.014585 5562 heartbeater.cc:511] Master 127.17.183.190:36103 requested a full tablet report, sending...
I20260812 01:14:57.014963 4697 ts_manager.cc:194] Registered new tserver with Master: 83b79fdd58c8470db37c5bb563f57e02 (127.17.183.131:34047)
I20260812 01:14:57.015333 4697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:35845
I20260812 01:14:57.018781 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:14:57.028090 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.020120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54706 (local address 127.17.183.190:36103)
0812 01:14:57.020197 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:57.020200 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:57.020269 (+ 69us) server_negotiation.cc:407] Connection header received
0812 01:14:57.020343 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:57.020344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:57.020354 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:57.020402 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:14:57.021004 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.021570 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.022522 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.022864 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.022931 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.024656 (+ 1725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:14:57.024657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:14:57.024658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:14:57.024667 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:14:57.026602 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:57.027079 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:57.027081 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:57.027081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:57.027148 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:14:57.027412 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:14:57.027413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:14:57.027414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:14:57.027649 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:14:57.027791 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:57.027909 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 01:14:57.027988 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 01:14:57.029987 4697 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54706:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:14:57.031556 4697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:14:57.039345 5592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.034156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:43035 (local address 127.0.0.1:51134)
0812 01:14:57.034493 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:57.034520 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:57.034591 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:57.035681 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:57.035682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:57.035684 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:57.035719 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.035720 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.036960 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.036961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.038092 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.038094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.039030 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.039031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.039116 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.039142 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 01:14:57.039210 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 01:14:57.039269 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":89,"threads_started":1}
I20260812 01:14:57.039374 5593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.034503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35316 (local address 127.17.183.129:36549)
0812 01:14:57.035117 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:57.035122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:57.035141 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:14:57.035195 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:57.035198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:57.035213 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:57.035289 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:57.035415 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.036546 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.038127 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.038856 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.038933 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.038991 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:57.039260 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 01:14:57.039298 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":121,"threads_started":1}
I20260812 01:14:57.039649 5584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.034376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:36549 (local address 127.0.0.1:35316)
0812 01:14:57.034531 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:57.034543 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:57.034602 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:57.035284 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:57.035285 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:57.035287 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:57.035328 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.035329 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.036662 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.036663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.038017 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.038021 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.039030 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.039031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.039120 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.039142 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 01:14:57.039210 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 01:14:57.039587 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":306,"thread_start_us":74,"threads_started":1}
I20260812 01:14:57.039943 5587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.034345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51134 (local address 127.17.183.130:43035)
0812 01:14:57.035436 (+ 1091us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:57.035441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:57.035452 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:14:57.035492 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:57.035494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:57.035509 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:57.035591 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:57.035794 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.036840 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.038190 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.038877 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.038935 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.038991 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:57.039805 (+ 814us) server_negotiation.cc:299] Negotiation successful
0812 01:14:57.039849 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1048,"thread_start_us":87,"threads_started":1}
I20260812 01:14:57.040426 5583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.034154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:34047 (local address 127.0.0.1:37016)
0812 01:14:57.034475 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:57.034520 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:57.034591 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:57.034925 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:57.034928 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:57.034930 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:57.034998 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.035000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.036816 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.036818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.038544 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.038549 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.040111 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.040112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.040215 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.040219 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:57.040282 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 01:14:57.040330 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":70,"threads_started":1}
I20260812 01:14:57.040722 5586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.034278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37016 (local address 127.17.183.131:34047)
0812 01:14:57.034760 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:57.034764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:57.034773 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:14:57.034807 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:57.034808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:57.034820 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:57.034907 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:57.035206 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.036689 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.038672 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.039917 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.039993 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.040067 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:57.040559 (+ 492us) server_negotiation.cc:299] Negotiation successful
0812 01:14:57.040614 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":85,"threads_started":1}
I20260812 01:14:57.040634 5187 tablet_service.cc:1467] Processing CreateTablet for tablet 87d7a43de0964d988ed53ed82501d832 (DEFAULT_TABLE table=test-table [id=d78cf905eef44f178d3de12cd8d783a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:57.040634 4931 tablet_service.cc:1467] Processing CreateTablet for tablet 87d7a43de0964d988ed53ed82501d832 (DEFAULT_TABLE table=test-table [id=d78cf905eef44f178d3de12cd8d783a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:57.041023 4931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87d7a43de0964d988ed53ed82501d832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:57.041023 5187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87d7a43de0964d988ed53ed82501d832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:57.044567 5596 tablet_bootstrap.cc:492] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: Bootstrap starting.
I20260812 01:14:57.045199 5436 tablet_service.cc:1467] Processing CreateTablet for tablet 87d7a43de0964d988ed53ed82501d832 (DEFAULT_TABLE table=test-table [id=d78cf905eef44f178d3de12cd8d783a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:14:57.045336 5596 tablet_bootstrap.cc:654] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:57.045595 5436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87d7a43de0964d988ed53ed82501d832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:14:57.046066 5596 log.cc:824] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:57.046480 5595 tablet_bootstrap.cc:492] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb: Bootstrap starting.
I20260812 01:14:57.046977 5596 tablet_bootstrap.cc:492] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: No bootstrap required, opened a new log
I20260812 01:14:57.047134 5596 ts_tablet_manager.cc:1397] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 01:14:57.047204 5595 tablet_bootstrap.cc:654] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:57.047837 5595 log.cc:824] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:57.048714 5595 tablet_bootstrap.cc:492] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb: No bootstrap required, opened a new log
I20260812 01:14:57.048813 5595 ts_tablet_manager.cc:1397] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:14:57.049211 5601 tablet_bootstrap.cc:492] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02: Bootstrap starting.
I20260812 01:14:57.049669 5596 raft_consensus.cc:348] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43035 } } peers { permanent_uuid: "efc05cc517d74b14a38351bb709723cb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36549 } } peers { permanent_uuid: "83b79fdd58c8470db37c5bb563f57e02" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34047 } }
I20260812 01:14:57.049832 5596 raft_consensus.cc:374] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:57.049877 5596 raft_consensus.cc:729] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6d4f2ab2a4953a6b7e787414eb666, State: Initialized, Role: FOLLOWER
I20260812 01:14:57.049924 5601 tablet_bootstrap.cc:654] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02: Neither blocks nor log segments found. Creating new log.
I20260812 01:14:57.050033 5596 consensus_queue.cc:260] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43035 } } peers { permanent_uuid: "efc05cc517d74b14a38351bb709723cb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36549 } } peers { permanent_uuid: "83b79fdd58c8470db37c5bb563f57e02" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34047 } }
I20260812 01:14:57.050485 5596 ts_tablet_manager.cc:1428] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:14:57.050551 5601 log.cc:824] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02: Log is configured to *not* fsync() on all Append() calls
I20260812 01:14:57.050629 5315 heartbeater.cc:503] Master 127.17.183.190:36103 was elected leader, sending a full tablet report...
I20260812 01:14:57.051338 5595 raft_consensus.cc:348] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43035 } } peers { permanent_uuid: "efc05cc517d74b14a38351bb709723cb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36549 } } peers { permanent_uuid: "83b79fdd58c8470db37c5bb563f57e02" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34047 } }
I20260812 01:14:57.051522 5595 raft_consensus.cc:374] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:57.051576 5595 raft_consensus.cc:729] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc05cc517d74b14a38351bb709723cb, State: Initialized, Role: FOLLOWER
I20260812 01:14:57.051707 5595 consensus_queue.cc:260] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43035 } } peers { permanent_uuid: "efc05cc517d74b14a38351bb709723cb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36549 } } peers { permanent_uuid: "83b79fdd58c8470db37c5bb563f57e02" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34047 } }
I20260812 01:14:57.051836 5601 tablet_bootstrap.cc:492] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02: No bootstrap required, opened a new log
I20260812 01:14:57.051914 5601 ts_tablet_manager.cc:1397] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 01:14:57.052031 5595 ts_tablet_manager.cc:1428] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:14:57.052166 5071 heartbeater.cc:503] Master 127.17.183.190:36103 was elected leader, sending a full tablet report...
I20260812 01:14:57.053910 5601 raft_consensus.cc:348] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43035 } } peers { permanent_uuid: "efc05cc517d74b14a38351bb709723cb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36549 } } peers { permanent_uuid: "83b79fdd58c8470db37c5bb563f57e02" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34047 } }
I20260812 01:14:57.054042 5601 raft_consensus.cc:374] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:14:57.054066 5601 raft_consensus.cc:729] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83b79fdd58c8470db37c5bb563f57e02, State: Initialized, Role: FOLLOWER
I20260812 01:14:57.054237 5601 consensus_queue.cc:260] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43035 } } peers { permanent_uuid: "efc05cc517d74b14a38351bb709723cb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36549 } } peers { permanent_uuid: "83b79fdd58c8470db37c5bb563f57e02" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34047 } }
I20260812 01:14:57.054540 5601 ts_tablet_manager.cc:1428] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:14:57.054556 5562 heartbeater.cc:503] Master 127.17.183.190:36103 was elected leader, sending a full tablet report...
W20260812 01:14:57.091641 5317 tablet.cc:2369] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:14:57.165912 5607 raft_consensus.cc:482] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:14:57.166041 5607 raft_consensus.cc:504] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43035 } } peers { permanent_uuid: "efc05cc517d74b14a38351bb709723cb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36549 } } peers { permanent_uuid: "83b79fdd58c8470db37c5bb563f57e02" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34047 } }
I20260812 01:14:57.166384 5607 leader_election.cc:288] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6d4f2ab2a4953a6b7e787414eb666 (127.17.183.130:43035), efc05cc517d74b14a38351bb709723cb (127.17.183.129:36549)
I20260812 01:14:57.169624 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.166801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:36549 (local address 127.17.183.131:45603)
0812 01:14:57.166983 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:57.166993 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:57.167050 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:57.167193 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:57.167194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:57.167196 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:57.167302 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.167304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.167978 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.167978 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.168777 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.168779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.169345 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.169346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.169423 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.169427 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:57.169497 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 01:14:57.169536 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":122,"threads_started":1}
I20260812 01:14:57.169612 5593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.166864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:45603 (local address 127.17.183.129:36549)
0812 01:14:57.166941 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:57.166943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:57.167059 (+ 116us) server_negotiation.cc:407] Connection header received
0812 01:14:57.167099 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:57.167100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:57.167114 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:57.167184 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:57.167378 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.167889 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.168872 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.169243 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.169345 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.169354 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:57.169504 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 01:14:57.169545 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:14:57.169718 5564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.166637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:43035 (local address 127.17.183.131:59149)
0812 01:14:57.166709 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:57.166723 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:14:57.166772 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:14:57.167071 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:14:57.167073 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:14:57.167076 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:14:57.167162 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.167165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.167855 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.167856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.168785 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:14:57.168788 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.169405 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.169406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:14:57.169499 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.169503 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:14:57.169587 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 01:14:57.169632 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 01:14:57.169938 5587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.166791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:59149 (local address 127.17.183.130:43035)
0812 01:14:57.166844 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:57.166847 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:57.166857 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:14:57.166889 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:57.166890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:57.166902 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:57.167011 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:14:57.167248 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.167771 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.168875 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.169298 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.169404 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.169414 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:57.169595 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 01:14:57.169635 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 01:14:57.170188 4966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d7a43de0964d988ed53ed82501d832" candidate_uuid: "83b79fdd58c8470db37c5bb563f57e02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc05cc517d74b14a38351bb709723cb" is_pre_election: true
I20260812 01:14:57.170248 5223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d7a43de0964d988ed53ed82501d832" candidate_uuid: "83b79fdd58c8470db37c5bb563f57e02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" is_pre_election: true
I20260812 01:14:57.170390 4966 raft_consensus.cc:2454] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83b79fdd58c8470db37c5bb563f57e02 in term 0.
I20260812 01:14:57.170392 5223 raft_consensus.cc:2454] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83b79fdd58c8470db37c5bb563f57e02 in term 0.
I20260812 01:14:57.170665 5355 leader_election.cc:302] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a6d4f2ab2a4953a6b7e787414eb666, 83b79fdd58c8470db37c5bb563f57e02; no voters:
I20260812 01:14:57.170804 5607 raft_consensus.cc:2781] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:14:57.170894 5607 raft_consensus.cc:482] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:14:57.170933 5607 raft_consensus.cc:3037] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:57.171697 5607 raft_consensus.cc:504] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43035 } } peers { permanent_uuid: "efc05cc517d74b14a38351bb709723cb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36549 } } peers { permanent_uuid: "83b79fdd58c8470db37c5bb563f57e02" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34047 } }
I20260812 01:14:57.171846 5607 leader_election.cc:288] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [CANDIDATE]: Term 1 election: Requested vote from peers 19a6d4f2ab2a4953a6b7e787414eb666 (127.17.183.130:43035), efc05cc517d74b14a38351bb709723cb (127.17.183.129:36549)
I20260812 01:14:57.172092 5223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d7a43de0964d988ed53ed82501d832" candidate_uuid: "83b79fdd58c8470db37c5bb563f57e02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6d4f2ab2a4953a6b7e787414eb666"
I20260812 01:14:57.172091 4966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d7a43de0964d988ed53ed82501d832" candidate_uuid: "83b79fdd58c8470db37c5bb563f57e02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc05cc517d74b14a38351bb709723cb"
I20260812 01:14:57.172186 4966 raft_consensus.cc:3037] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:57.172186 5223 raft_consensus.cc:3037] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:14:57.173213 5223 raft_consensus.cc:2454] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83b79fdd58c8470db37c5bb563f57e02 in term 1.
I20260812 01:14:57.173213 4966 raft_consensus.cc:2454] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83b79fdd58c8470db37c5bb563f57e02 in term 1.
I20260812 01:14:57.173430 5355 leader_election.cc:302] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83b79fdd58c8470db37c5bb563f57e02, efc05cc517d74b14a38351bb709723cb; no voters:
I20260812 01:14:57.173585 5607 raft_consensus.cc:2781] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:14:57.173774 5607 raft_consensus.cc:686] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 1 LEADER]: Becoming Leader. State: Replica: 83b79fdd58c8470db37c5bb563f57e02, State: Running, Role: LEADER
I20260812 01:14:57.173892 5607 consensus_queue.cc:237] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43035 } } peers { permanent_uuid: "efc05cc517d74b14a38351bb709723cb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36549 } } peers { permanent_uuid: "83b79fdd58c8470db37c5bb563f57e02" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34047 } }
I20260812 01:14:57.174865 4697 catalog_manager.cc:5495] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83b79fdd58c8470db37c5bb563f57e02 (127.17.183.131). New cstate: current_term: 1 leader_uuid: "83b79fdd58c8470db37c5bb563f57e02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc05cc517d74b14a38351bb709723cb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83b79fdd58c8470db37c5bb563f57e02" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 34047 } health_report { overall_health: HEALTHY } } }
I20260812 01:14:57.183619 5586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.181560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37018 (local address 127.17.183.131:34047)
0812 01:14:57.181620 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 01:14:57.181622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:14:57.181637 (+ 15us) server_negotiation.cc:407] Connection header received
0812 01:14:57.181666 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:14:57.181667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:14:57.181682 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:14:57.181741 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:14:57.181840 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.182278 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.182971 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:14:57.183142 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:14:57.183191 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:14:57.183318 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:14:57.183407 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:14:57.183463 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 01:14:57.183494 (+ 31us) server_negotiation.cc:299] Negotiation successful
0812 01:14:57.183509 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260812 01:14:57.184172 5072 tablet.cc:2369] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:14:57.185381 5223 raft_consensus.cc:1261] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666 [term 1 FOLLOWER]: Refusing update from remote peer 83b79fdd58c8470db37c5bb563f57e02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:57.185364 4966 raft_consensus.cc:1261] T 87d7a43de0964d988ed53ed82501d832 P efc05cc517d74b14a38351bb709723cb [term 1 FOLLOWER]: Refusing update from remote peer 83b79fdd58c8470db37c5bb563f57e02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:14:57.185674 5607 consensus_queue.cc:1035] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6d4f2ab2a4953a6b7e787414eb666" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:57.185858 5610 consensus_queue.cc:1035] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc05cc517d74b14a38351bb709723cb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 36549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:14:57.188218 5615 mvcc.cc:205] Tried to move back new op lower bound from 7317492929268903936 to 7317492929225146368. Current Snapshot: MvccSnapshot[applied={T|T < 7317492929268903936}]
I20260812 01:14:57.189047 5621 mvcc.cc:205] Tried to move back new op lower bound from 7317492929268903936 to 7317492929225146368. Current Snapshot: MvccSnapshot[applied={T|T < 7317492929268903936}]
I20260812 01:14:57.190706 4696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:57.190814 4696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:14:57.191613 4696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6bfe9d52bf4249eab81cbd1b31483b9c: Sending DeleteTablet for 3 replicas of tablet 87d7a43de0964d988ed53ed82501d832
I20260812 01:14:57.192067 5187 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d7a43de0964d988ed53ed82501d832 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:57 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:51134
I20260812 01:14:57.192065 4931 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d7a43de0964d988ed53ed82501d832 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:57 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:35316
I20260812 01:14:57.192250 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 4810
I20260812 01:14:57.192344 5436 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d7a43de0964d988ed53ed82501d832 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:14:57 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:37016
I20260812 01:14:57.205724 5635 tablet_replica.cc:330] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02: stopping tablet replica
I20260812 01:14:57.205843 5635 raft_consensus.cc:2229] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:14:57.205938 5635 raft_consensus.cc:2258] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:57.206090 5634 tablet_replica.cc:330] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: stopping tablet replica
I20260812 01:14:57.206184 5634 raft_consensus.cc:2229] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:14:57.206278 5634 raft_consensus.cc:2258] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:14:57.207320 5635 ts_tablet_manager.cc:1905] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:57.208546 5634 ts_tablet_manager.cc:1905] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:14:57.209209 5635 ts_tablet_manager.cc:1918] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:57.209332 5635 log.cc:1196] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/87d7a43de0964d988ed53ed82501d832
I20260812 01:14:57.209632 5635 ts_tablet_manager.cc:1939] T 87d7a43de0964d988ed53ed82501d832 P 83b79fdd58c8470db37c5bb563f57e02: Deleting consensus metadata
I20260812 01:14:57.210111 4665 catalog_manager.cc:4841] TS 83b79fdd58c8470db37c5bb563f57e02 (127.17.183.131:34047): tablet 87d7a43de0964d988ed53ed82501d832 (table test-table [id=d78cf905eef44f178d3de12cd8d783a9]) successfully deleted
I20260812 01:14:57.210289 5634 ts_tablet_manager.cc:1918] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:14:57.210397 5634 log.cc:1196] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/87d7a43de0964d988ed53ed82501d832
I20260812 01:14:57.210662 5634 ts_tablet_manager.cc:1939] T 87d7a43de0964d988ed53ed82501d832 P 19a6d4f2ab2a4953a6b7e787414eb666: Deleting consensus metadata
I20260812 01:14:57.211066 4672 catalog_manager.cc:4841] TS 19a6d4f2ab2a4953a6b7e787414eb666 (127.17.183.130:43035): tablet 87d7a43de0964d988ed53ed82501d832 (table test-table [id=d78cf905eef44f178d3de12cd8d783a9]) successfully deleted
W20260812 01:14:57.214808 4672 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:36549 (error 108)
I20260812 01:14:57.215379 5583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:14:57.215243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:36549 (local address 127.0.0.1:35322)
0812 01:14:57.215285 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 01:14:57.215326 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:36549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 01:14:57.215500 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 5080
W20260812 01:14:57.227648 4672 catalog_manager.cc:4584] TS efc05cc517d74b14a38351bb709723cb (127.17.183.129:36549): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 87d7a43de0964d988ed53ed82501d832: Network error: Client connection negotiation failed: client connection to 127.17.183.129:36549: connect: Connection refused (error 111)
I20260812 01:14:57.238008 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 5324
I20260812 01:14:57.258361 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 4632
2026-08-12T01:14:57Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2310 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:14:57 dist-test-slave-rwrg krb5kdc[5642](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:14:57 dist-test-slave-rwrg krb5kdc[5642](info): set up 2 sockets
Aug 12 01:14:57 dist-test-slave-rwrg krb5kdc[5642](info): commencing operation
krb5kdc: starting...
W20260812 01:14:58.558064 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:14:58 dist-test-slave-rwrg krb5kdc[5642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:14:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:14:58Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.183.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.183.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/rangeradmin_127.17.183.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/rangeradmin_127.17.183.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.183.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.183.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/rangerlookup_127.17.183.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/rangerlookup_127.17.183.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.183.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.183.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/HTTP_127.17.183.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/HTTP_127.17.183.148@KRBTEST.COM.keytab.
I20260812 01:14:58.727604 18142 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskog5hhV/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/postgres -l logfile start
2026-08-12 01:15:01.187 UTC [5700] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 01:15:01.187 UTC [5700] LOG: listening on IPv4 address "127.17.183.148", port 35863
2026-08-12 01:15:01.191 UTC [5700] LOG: listening on Unix socket "/tmp/.s.PGSQL.35863"
2026-08-12 01:15:01.233 UTC [5703] LOG: database system was shut down at 2026-08-12 01:14:59 UTC
2026-08-12 01:15:01.237 UTC [5700] LOG: database system is ready to accept connections
I20260812 01:15:02.446789 18142 mini_postgres.cc:96] Postgres bound to 35863
2026-08-12 01:15:02.454 UTC [5719] FATAL: database "slave" does not exist
127.17.183.148:35863 - accepting connections
I20260812 01:15:02.454705 18142 mini_ranger.cc:161] Starting Ranger...
I20260812 01:15:02.470113 18142 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 01:15:02.923326 18142 mini_ranger.cc:87] Created ranger Postgres database
I20260812 01:15:02.923415 18142 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-admin
2026-08-12 01:15:03,218 [I] DB FLAVOR :POSTGRES
2026-08-12 01:15:03,219 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 01:15:03,219 [I] Checking connection..
2026-08-12 01:15:03,219 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 01:15:03,492 [I] Checking connection passed.
2026-08-12 01:15:03,493 [I] --------- Verifying version history table ---------
2026-08-12 01:15:03,493 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:15:03,755 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 01:15:03,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:15:04,029 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 01:15:04,030 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 01:15:04,030 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 01:15:04.294 UTC [5814] WARNING: there is no transaction in progress
2026-08-12 01:15:04,304 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 01:15:04,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:15:04,563 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 01:15:04,563 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 01:15:04,563 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 01:15:04,830 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 01:15:05,094 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-rwrg.c.gcp-upstream.internal','N') ;"
2026-08-12 01:15:05,351 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 01:15:05,623 [I] Table x_portal_user does not exist in database ranger
2026-08-12 01:15:05,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 01:15:05,894 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 01:15:05,894 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 01:15:06,150 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 01:15:06,416 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 01:15:06,417 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 01:15:07.368 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.384 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.401 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.417 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.432 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.450 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.508 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.515 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.528 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.538 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.548 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.561 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.570 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.576 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.582 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:07.588 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 01:15:08,209 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 01:15:08,209 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 01:15:08,454 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 01:15:08,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 01:15:08,725 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 01:15:08,725 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 01:15:08,994 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 01:15:08,994 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 01:15:09,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 01:15:09,525 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-rwrg.c.gcp-upstream.internal';"
2026-08-12 01:15:09,780 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 01:15:09,780 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 01:15:10,049 [I] DB_PATCHES have already been applied
I20260812 01:15:10.055482 18142 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-admin:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskog5hhV/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 01:15:10.055555 18142 mini_ranger.cc:193] Using host: 127.17.183.148
I20260812 01:15:10.059357 18142 mini_ranger.cc:227] Ranger admin URL: http://127.17.183.148:58019
Aug 12, 2026 1:15:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 1:15:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 1:15:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 1:15:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 1:15:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 1:15:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 1:15:11 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 01:15:11.512928 18142 mini_ranger.cc:160] Time spent starting Ranger: real 9.058s user 0.003s sys 0.008s
Aug 12, 2026 1:15:33 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 1:15:33 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 1:15:33 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 1:15:33 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 1:15:34 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 01:15:34.795714 18142 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.183.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.183.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/rangerkms_127.17.183.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/rangerkms_127.17.183.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.183.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.183.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.183.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/HTTP_127.17.183.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.183.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/HTTP_127.17.183.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 01:15:34 dist-test-slave-rwrg krb5kdc[5642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497334, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 01:15:34.884377 18142 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 01:15:34.894034 18142 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 01:15:35.712222 18142 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 01:15:35.712316 18142 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-kms
I20260812 01:15:35.712329 18142 mini_ranger_kms.cc:227] Using postgres at 127.17.183.148:35863
2026-08-12 01:15:36,373 [I] DB FLAVOR :POSTGRES
2026-08-12 01:15:36,373 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 01:15:36,373 [I] Checking connection
2026-08-12 01:15:36,373 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 01:15:36,723 [I] connection success
2026-08-12 01:15:36,724 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 01:15:36,724 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 01:15:36,724 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 01:15:36,992 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 01:15:36,993 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 01:15:36,993 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 01:15:36,993 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:35863/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 01:15:37,299 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 01:15:37.789016 18142 mini_ranger_kms.cc:310] Created kms service
I20260812 01:15:38.015580 18142 mini_ranger_kms.cc:326] Created kudu user
I20260812 01:15:38.064524 18142 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 01:15:38 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497334, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:15:38.454488 18142 mini_ranger_kms.cc:384] Added ranger policy
I20260812 01:15:38.454612 18142 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-kms:/tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 01:15:38.454633 18142 mini_ranger_kms.cc:240] Using host: 127.17.183.148
I20260812 01:15:38.459714 18142 mini_ranger_kms.cc:276] Ranger KMS PID: 6344
I20260812 01:15:38.459836 18142 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.183.148:34143
Aug 12, 2026 1:15:39 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 1:15:39 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 1:15:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 1:15:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 1:15:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 1:15:40 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 01:15:41 dist-test-slave-rwrg krb5kdc[5642](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786497341, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.183.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:15:41.318455 18142 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.434s user 0.000s sys 0.621s
I20260812 01:15:41.318578 18142 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 01:15:41.318670 18142 mini_ranger_kms.cc:401] 127.17.183.148:34143/kms/v1/keys
Aug 12 01:15:41 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497341, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.183.148@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
Aug 12 01:15:42 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497341, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.183.148@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
Aug 12 01:15:44 dist-test-slave-rwrg krb5kdc[5642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:15:44.763484 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:37803
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:37965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:37803
--ranger_config_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:34143/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:15:44.885538 6431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:15:44.885741 6431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:15:44.885763 6431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:15:44.886926 6431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:15:44.886971 6431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:15:44.886986 6431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:15:44.886998 6431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:15:44.887053 6431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:15:44.889145 6431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.183.148:34143/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:37803
--ranger_config_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:37803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:15:44.889422 6431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:15:44.889675 6431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:15:44.895069 6441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:15:44.895059 6440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:15:44.895058 6446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:15:44.895210 6431 server_base.cc:1034] running on GCE node
I20260812 01:15:44.895678 6431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:15:44.896019 6431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:15:44.897197 6431 hybrid_clock.cc:648] HybridClock initialized: now 1786497344897182 us; error 29 us; skew 500 ppm
Aug 12 01:15:44 dist-test-slave-rwrg krb5kdc[5642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497344, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:15:44.899821 6431 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:15:44.900269 6431 webserver.cc:460] Webserver started at http://127.17.183.190:43195/ using document root <none> and password file <none>
I20260812 01:15:44.900548 6431 fs_manager.cc:359] Metadata directory not provided
I20260812 01:15:44.900594 6431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:15:44.900739 6431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:15:44 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497344, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:15:44.957446 6431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "a317e85718214df1b219c28f13c25834"
format_stamp: "Formatted at 2026-08-12 01:15:44 on dist-test-slave-rwrg"
server_key: "884633e163afec46d6def71b0bd9b864"
server_key_iv: "38dacf6ad0e6f3694ff2a80c2c6dacf2"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:44.957911 6431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "a317e85718214df1b219c28f13c25834"
format_stamp: "Formatted at 2026-08-12 01:15:44 on dist-test-slave-rwrg"
server_key: "884633e163afec46d6def71b0bd9b864"
server_key_iv: "38dacf6ad0e6f3694ff2a80c2c6dacf2"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:44.959602 6431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:15:44.972055 6458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:15:44.972270 6431 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:15:44.972381 6431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "a317e85718214df1b219c28f13c25834"
format_stamp: "Formatted at 2026-08-12 01:15:44 on dist-test-slave-rwrg"
server_key: "884633e163afec46d6def71b0bd9b864"
server_key_iv: "38dacf6ad0e6f3694ff2a80c2c6dacf2"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:44.972527 6431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:15:44.989661 6431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:15:44.992034 6431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:15:44.992223 6431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:15:45.000070 6431 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:37803
I20260812 01:15:45.000149 6563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:37803 every 8 connection(s)
I20260812 01:15:45.000695 6431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:15:45.001279 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 6431
I20260812 01:15:45.001400 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:15:45.001590 18142 external_mini_cluster.cc:1428] Setting key a26c19cb4985c66cfcf4dd3121f3924e
I20260812 01:15:45.001801 6564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:15:45.006525 6564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834: Bootstrap starting.
I20260812 01:15:45.007808 6564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834: Neither blocks nor log segments found. Creating new log.
I20260812 01:15:45.008394 6564 log.cc:824] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834: Log is configured to *not* fsync() on all Append() calls
Aug 12 01:15:45 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:15:45.009310 6564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834: No bootstrap required, opened a new log
I20260812 01:15:45.012691 6564 raft_consensus.cc:348] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a317e85718214df1b219c28f13c25834" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 37803 } }
I20260812 01:15:45.012979 6564 raft_consensus.cc:374] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:15:45.013126 6564 raft_consensus.cc:729] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a317e85718214df1b219c28f13c25834, State: Initialized, Role: FOLLOWER
I20260812 01:15:45.013304 6564 consensus_queue.cc:260] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a317e85718214df1b219c28f13c25834" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 37803 } }
I20260812 01:15:45.013355 6569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:45.002310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45412 (local address 127.17.183.190:37803)
0812 01:15:45.002582 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0812 01:15:45.002592 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:15:45.002627 (+ 35us) server_negotiation.cc:407] Connection header received
0812 01:15:45.003300 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:15:45.003309 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:15:45.003362 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:15:45.003531 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:15:45.004205 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:45.005432 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:45.006224 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:45.006704 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:45.006837 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:45.009711 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:15:45.009715 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:15:45.009715 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:15:45.009727 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:15:45.011615 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:15:45.012005 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:15:45.012008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:15:45.012008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:15:45.012101 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:15:45.012323 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:15:45.012324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:15:45.012325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:15:45.012643 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:15:45.012869 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0812 01:15:45.012943 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 01:15:45.013070 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":185,"threads_started":1}
I20260812 01:15:45.013392 6564 raft_consensus.cc:388] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:15:45.013612 6564 raft_consensus.cc:482] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:15:45.013675 6564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:15:45.014876 6564 raft_consensus.cc:504] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a317e85718214df1b219c28f13c25834" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 37803 } }
I20260812 01:15:45.014991 6564 leader_election.cc:302] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a317e85718214df1b219c28f13c25834; no voters:
I20260812 01:15:45.015166 6564 leader_election.cc:288] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:15:45.015244 6571 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:15:45.015398 6571 raft_consensus.cc:686] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [term 1 LEADER]: Becoming Leader. State: Replica: a317e85718214df1b219c28f13c25834, State: Running, Role: LEADER
I20260812 01:15:45.015422 6564 sys_catalog.cc:564] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:15:45.016268 6571 consensus_queue.cc:237] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a317e85718214df1b219c28f13c25834" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 37803 } }
I20260812 01:15:45.017513 6574 sys_catalog.cc:455] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a317e85718214df1b219c28f13c25834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a317e85718214df1b219c28f13c25834" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 37803 } } }
I20260812 01:15:45.017602 6574 sys_catalog.cc:458] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [sys.catalog]: This master's current role is: LEADER
I20260812 01:15:45.017684 6564 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 01:15:45.018229 6573 sys_catalog.cc:455] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a317e85718214df1b219c28f13c25834. Latest consensus state: current_term: 1 leader_uuid: "a317e85718214df1b219c28f13c25834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a317e85718214df1b219c28f13c25834" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 37803 } } }
I20260812 01:15:45.018308 6573 sys_catalog.cc:458] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834 [sys.catalog]: This master's current role is: LEADER
I20260812 01:15:45.024554 6597 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:15:45.025302 6597 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:15:45.028071 6597 catalog_manager.cc:1347] Generated new cluster ID: 558b620c8f3349ceaca3e50a2a3b275b
I20260812 01:15:45.028151 6597 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:15:45.077183 6597 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:15:45.078142 6597 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:15:45.086731 6597 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834: Generated new TSK 0
I20260812 01:15:45.086934 6597 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:15:45.903185 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:34143/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:37803
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:37965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:15:46.029299 6645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:15:46.029497 6645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:15:46.029521 6645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:15:46.030716 6645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:15:46.030762 6645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:15:46.030789 6645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:15:46.032593 6645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.183.148:34143/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:37803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:15:46.032824 6645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:15:46.033095 6645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:15:46.039274 6650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:15:46.039294 6652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:15:46.039492 6656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:15:46.039738 6645 server_base.cc:1034] running on GCE node
I20260812 01:15:46.039970 6645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:15:46.040249 6645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:15:46.041414 6645 hybrid_clock.cc:648] HybridClock initialized: now 1786497346041387 us; error 41 us; skew 500 ppm
Aug 12 01:15:46 dist-test-slave-rwrg krb5kdc[5642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497346, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:15:46.044457 6645 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:15:46.045099 6645 webserver.cc:460] Webserver started at http://127.17.183.129:43343/ using document root <none> and password file <none>
I20260812 01:15:46.045383 6645 fs_manager.cc:359] Metadata directory not provided
I20260812 01:15:46.045465 6645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:15:46.045616 6645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:15:46 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497346, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:15:46.060074 6645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "10795f5614a843a4a31433ad6e95ea95"
format_stamp: "Formatted at 2026-08-12 01:15:46 on dist-test-slave-rwrg"
server_key: "d9d33eb909c108dc779d95dd7338ca7c"
server_key_iv: "3224908653108d83b5ce08c87f3403cf"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:46.061177 6645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "10795f5614a843a4a31433ad6e95ea95"
format_stamp: "Formatted at 2026-08-12 01:15:46 on dist-test-slave-rwrg"
server_key: "d9d33eb909c108dc779d95dd7338ca7c"
server_key_iv: "3224908653108d83b5ce08c87f3403cf"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:46.064191 6645 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260812 01:15:46.080699 6677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:15:46.080922 6645 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260812 01:15:46.081050 6645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "10795f5614a843a4a31433ad6e95ea95"
format_stamp: "Formatted at 2026-08-12 01:15:46 on dist-test-slave-rwrg"
server_key: "d9d33eb909c108dc779d95dd7338ca7c"
server_key_iv: "3224908653108d83b5ce08c87f3403cf"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:46.081156 6645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:15:46.090523 6645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:15:46.093087 6645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:15:46.093338 6645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:15:46.093703 6645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:15:46.094130 6645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:15:46.094178 6645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:15:46.094208 6645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:15:46.094233 6645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:15:46.109486 6645 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:37493
I20260812 01:15:46.109614 6881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:37493 every 8 connection(s)
I20260812 01:15:46.110020 6645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:15:46.115072 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 6645
I20260812 01:15:46.115201 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:15:46.115429 18142 external_mini_cluster.cc:1428] Setting key f3f9149323eb22f65db7bff75912e056
Aug 12 01:15:46 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497346, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:15:46.122684 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.110989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:43029 (local address 127.17.183.190:37803)
0812 01:15:46.111124 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 01:15:46.111126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:15:46.111437 (+ 311us) server_negotiation.cc:407] Connection header received
0812 01:15:46.112341 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:15:46.112343 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:15:46.112358 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:15:46.112399 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:15:46.113443 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.114284 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.115827 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.116145 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.116187 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.119177 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:15:46.119178 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:15:46.119178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:15:46.119186 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:15:46.121065 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:15:46.121576 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:15:46.121578 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:15:46.121578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:15:46.121641 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:15:46.121914 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:15:46.121915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:15:46.121915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:15:46.122049 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:15:46.122091 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 01:15:46.122485 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 01:15:46.122572 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":62,"threads_started":1}
I20260812 01:15:46.123355 6890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.110949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:37803 (local address 127.17.183.129:43029)
0812 01:15:46.111257 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0812 01:15:46.111307 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 01:15:46.112195 (+ 888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:15:46.112614 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:15:46.112618 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:15:46.112959 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:15:46.113324 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.113331 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.114414 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.114415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.115726 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.115729 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.116572 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.116573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.116717 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.117367 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:15:46.117378 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:15:46.119063 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:15:46.121182 (+ 2119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:15:46.121190 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:15:46.121192 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:15:46.121487 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:15:46.121710 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:15:46.121711 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:15:46.121711 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:15:46.121838 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:15:46.122138 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:15:46.122144 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:15:46.122329 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 01:15:46.123037 (+ 708us) client_negotiation.cc:240] Negotiation successful
0812 01:15:46.123181 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":201,"threads_started":1}
I20260812 01:15:46.124073 6884 heartbeater.cc:347] Connected to a master server at 127.17.183.190:37803
I20260812 01:15:46.124197 6884 heartbeater.cc:464] Registering TS with master...
I20260812 01:15:46.124388 6884 heartbeater.cc:511] Master 127.17.183.190:37803 requested a full tablet report, sending...
I20260812 01:15:46.125033 6492 ts_manager.cc:194] Registered new tserver with Master: 10795f5614a843a4a31433ad6e95ea95 (127.17.183.129:37493)
I20260812 01:15:46.125953 6492 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:43029
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:15:46.153512 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:34143/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:37803
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:37965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:15:46.274279 6895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:15:46.274510 6895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:15:46.274590 6895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:15:46.276074 6895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:15:46.276139 6895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:15:46.276183 6895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:15:46.278401 6895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.183.148:34143/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:37803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:15:46.278680 6895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:15:46.278959 6895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:15:46.284898 6909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:15:46.285181 6904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:15:46.285264 6907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:15:46.285290 6895 server_base.cc:1034] running on GCE node
I20260812 01:15:46.285567 6895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:15:46.285847 6895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:15:46.286998 6895 hybrid_clock.cc:648] HybridClock initialized: now 1786497346286973 us; error 42 us; skew 500 ppm
Aug 12 01:15:46 dist-test-slave-rwrg krb5kdc[5642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497346, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:15:46.290110 6895 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:15:46.290546 6895 webserver.cc:460] Webserver started at http://127.17.183.130:36623/ using document root <none> and password file <none>
I20260812 01:15:46.290782 6895 fs_manager.cc:359] Metadata directory not provided
I20260812 01:15:46.290853 6895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:15:46.290997 6895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:15:46 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497346, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
Aug 12 01:15:46 dist-test-slave-rwrg krb5kdc[5642](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786497346, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:15:46.316741 6895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "4a69efe5ccf24a469fe220ea536fd06a"
format_stamp: "Formatted at 2026-08-12 01:15:46 on dist-test-slave-rwrg"
server_key: "55bdd2484b61aa76a73b0de4f23bc40c"
server_key_iv: "e039bf10b1d73c1c9b985fb4a2a1aa1d"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:46.317382 6895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "4a69efe5ccf24a469fe220ea536fd06a"
format_stamp: "Formatted at 2026-08-12 01:15:46 on dist-test-slave-rwrg"
server_key: "55bdd2484b61aa76a73b0de4f23bc40c"
server_key_iv: "e039bf10b1d73c1c9b985fb4a2a1aa1d"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:46.322780 6895 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.000s
I20260812 01:15:46.337707 6922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:15:46.337954 6895 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:15:46.338049 6895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "4a69efe5ccf24a469fe220ea536fd06a"
format_stamp: "Formatted at 2026-08-12 01:15:46 on dist-test-slave-rwrg"
server_key: "55bdd2484b61aa76a73b0de4f23bc40c"
server_key_iv: "e039bf10b1d73c1c9b985fb4a2a1aa1d"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:46.338150 6895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:15:46.377892 6895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:15:46.380277 6895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:15:46.380443 6895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:15:46.380752 6895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:15:46.381161 6895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:15:46.381217 6895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:15:46.381283 6895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:15:46.381312 6895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:15:46.390329 6895 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:42191
I20260812 01:15:46.390769 6895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:15:46.395172 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 6895
I20260812 01:15:46.395309 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:15:46.395512 18142 external_mini_cluster.cc:1428] Setting key 7f97f862614b805c8d1127ced811ee26
I20260812 01:15:46.401295 7136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:42191 every 8 connection(s)
Aug 12 01:15:46 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497346, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:15:46.412195 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.402234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:33893 (local address 127.17.183.190:37803)
0812 01:15:46.402416 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 01:15:46.402420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:15:46.402701 (+ 281us) server_negotiation.cc:407] Connection header received
0812 01:15:46.403625 (+ 924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:15:46.403634 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:15:46.403650 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:15:46.403683 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:15:46.404611 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.405156 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.406269 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.406494 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.406586 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.409208 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:15:46.409210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:15:46.409210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:15:46.409218 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:15:46.410749 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:15:46.411166 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:15:46.411167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:15:46.411167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:15:46.411227 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:15:46.411497 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:15:46.411498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:15:46.411498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:15:46.411636 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:15:46.411708 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 01:15:46.411999 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 01:15:46.412102 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
I20260812 01:15:46.412431 7140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.402112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:37803 (local address 127.17.183.130:33893)
0812 01:15:46.402491 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0812 01:15:46.402608 (+ 117us) client_negotiation.cc:174] Beginning negotiation
0812 01:15:46.403474 (+ 866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:15:46.403881 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:15:46.403886 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:15:46.404154 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:15:46.404440 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.404448 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.405265 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.405266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.406171 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.406173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.406598 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.406599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.406785 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.407513 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:15:46.407523 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:15:46.409094 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:15:46.410852 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:15:46.410860 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:15:46.410863 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:15:46.411089 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:15:46.411308 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:15:46.411309 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:15:46.411310 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:15:46.411422 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:15:46.411713 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:15:46.411721 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:15:46.411860 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 01:15:46.411965 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 01:15:46.412117 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":105,"threads_started":1}
I20260812 01:15:46.413179 7137 heartbeater.cc:347] Connected to a master server at 127.17.183.190:37803
I20260812 01:15:46.413307 7137 heartbeater.cc:464] Registering TS with master...
I20260812 01:15:46.413530 7137 heartbeater.cc:511] Master 127.17.183.190:37803 requested a full tablet report, sending...
I20260812 01:15:46.413959 6492 ts_manager.cc:194] Registered new tserver with Master: 4a69efe5ccf24a469fe220ea536fd06a (127.17.183.130:42191)
I20260812 01:15:46.414330 6492 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:33893
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:15:46.435091 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:34143/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:37803
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:37965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:15:46.566022 7142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:15:46.566311 7142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:15:46.566346 7142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:15:46.567973 7142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:15:46.568089 7142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:15:46.568153 7142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:15:46.570442 7142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.183.148:34143/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:37803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:15:46.570710 7142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:15:46.571022 7142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:15:46.576297 7153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:15:46.576303 7155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:15:46.576314 7159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:15:46.576654 7142 server_base.cc:1034] running on GCE node
I20260812 01:15:46.576855 7142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:15:46.577148 7142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:15:46.578325 7142 hybrid_clock.cc:648] HybridClock initialized: now 1786497346578308 us; error 35 us; skew 500 ppm
Aug 12 01:15:46 dist-test-slave-rwrg krb5kdc[5642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497346, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:15:46.581077 7142 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:15:46.581558 7142 webserver.cc:460] Webserver started at http://127.17.183.131:36001/ using document root <none> and password file <none>
I20260812 01:15:46.581812 7142 fs_manager.cc:359] Metadata directory not provided
I20260812 01:15:46.581857 7142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:15:46.581987 7142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:15:46 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497346, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:15:46.596451 7142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "aa7a0b5039634a54b6f554b9bac96a55"
format_stamp: "Formatted at 2026-08-12 01:15:46 on dist-test-slave-rwrg"
server_key: "67bf43a907baf49299c203f97694d3e0"
server_key_iv: "b70f3a0ed13c04d9ea7ad360951b7d03"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:46.596982 7142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "aa7a0b5039634a54b6f554b9bac96a55"
format_stamp: "Formatted at 2026-08-12 01:15:46 on dist-test-slave-rwrg"
server_key: "67bf43a907baf49299c203f97694d3e0"
server_key_iv: "b70f3a0ed13c04d9ea7ad360951b7d03"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:46.599285 7142 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260812 01:15:46.628103 7172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:15:46.628486 7142 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.000s sys 0.000s
I20260812 01:15:46.628659 7142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "aa7a0b5039634a54b6f554b9bac96a55"
format_stamp: "Formatted at 2026-08-12 01:15:46 on dist-test-slave-rwrg"
server_key: "67bf43a907baf49299c203f97694d3e0"
server_key_iv: "b70f3a0ed13c04d9ea7ad360951b7d03"
server_key_version: "kuduclusterkey@0"
I20260812 01:15:46.628798 7142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:15:46.646641 7142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:15:46.649526 7142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:15:46.649775 7142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:15:46.650151 7142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:15:46.650624 7142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:15:46.650679 7142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:15:46.650712 7142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:15:46.650730 7142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:15:46.662212 7142 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:36559
I20260812 01:15:46.662582 7378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:36559 every 8 connection(s)
I20260812 01:15:46.662700 7142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:15:46.666103 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 7142
I20260812 01:15:46.666229 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:15:46.666435 18142 external_mini_cluster.cc:1428] Setting key 4d9569832d90deb8b3e829d35cbef9ca
Aug 12 01:15:46 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497346, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:15:46.675192 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.663591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:39897 (local address 127.17.183.190:37803)
0812 01:15:46.663645 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 01:15:46.663648 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:15:46.664007 (+ 359us) server_negotiation.cc:407] Connection header received
0812 01:15:46.664950 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:15:46.664952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:15:46.664965 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:15:46.665000 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:15:46.665931 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.666706 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.668217 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.668550 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.668602 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.671596 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:15:46.671598 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:15:46.671599 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:15:46.671607 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:15:46.673438 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:15:46.673956 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:15:46.673957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:15:46.673958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:15:46.674021 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:15:46.674337 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:15:46.674338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:15:46.674339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:15:46.674483 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:15:46.674562 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 01:15:46.674992 (+ 430us) server_negotiation.cc:299] Negotiation successful
0812 01:15:46.675085 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 01:15:46.675424 7386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.663562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:37803 (local address 127.17.183.131:39897)
0812 01:15:46.663833 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 01:15:46.663885 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 01:15:46.664790 (+ 905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:15:46.665214 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:15:46.665218 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:15:46.665487 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:15:46.665775 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.665783 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.666832 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.666833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.668092 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.668095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.668706 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.668706 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.668859 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.669578 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:15:46.669589 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:15:46.671483 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:15:46.673538 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:15:46.673545 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:15:46.673547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:15:46.673859 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:15:46.674108 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:15:46.674109 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:15:46.674110 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:15:46.674253 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:15:46.674581 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:15:46.674589 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:15:46.674755 (+ 166us) client_negotiation.cc:769] Sending connection context
0812 01:15:46.674942 (+ 187us) client_negotiation.cc:240] Negotiation successful
0812 01:15:46.675119 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":107,"threads_started":1}
I20260812 01:15:46.676852 7379 heartbeater.cc:347] Connected to a master server at 127.17.183.190:37803
I20260812 01:15:46.676957 7379 heartbeater.cc:464] Registering TS with master...
I20260812 01:15:46.677170 7379 heartbeater.cc:511] Master 127.17.183.190:37803 requested a full tablet report, sending...
I20260812 01:15:46.677606 6492 ts_manager.cc:194] Registered new tserver with Master: aa7a0b5039634a54b6f554b9bac96a55 (127.17.183.131:36559)
I20260812 01:15:46.678102 6492 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:39897
I20260812 01:15:46.678110 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:15:46.688771 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.680172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45420 (local address 127.17.183.190:37803)
0812 01:15:46.680214 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 01:15:46.680216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:15:46.680681 (+ 465us) server_negotiation.cc:407] Connection header received
0812 01:15:46.680779 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:15:46.680780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:15:46.680791 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:15:46.680820 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:15:46.681739 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.682446 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.683570 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.683898 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.683988 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.685675 (+ 1687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:15:46.685677 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:15:46.685677 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:15:46.685685 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:15:46.687431 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:15:46.687851 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:15:46.687852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:15:46.687852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:15:46.687910 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:15:46.688142 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:15:46.688143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:15:46.688143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:15:46.688272 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:15:46.688345 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:15:46.688608 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 01:15:46.688687 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 01:15:46.691180 6492 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45420:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:15:46.693660 6492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:15:46.715278 7417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.705268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34302 (local address 127.17.183.129:37493)
0812 01:15:46.705467 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 01:15:46.705474 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:15:46.707160 (+ 1686us) server_negotiation.cc:407] Connection header received
0812 01:15:46.707290 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:15:46.707293 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:15:46.707310 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:15:46.707370 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:15:46.709102 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.710202 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.713705 (+ 3503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.714671 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.714736 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.714816 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 01:15:46.715133 (+ 317us) server_negotiation.cc:299] Negotiation successful
0812 01:15:46.715182 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":118,"threads_started":1}
I20260812 01:15:46.715873 7410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.705004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:37493 (local address 127.0.0.1:34302)
0812 01:15:46.706174 (+ 1170us) negotiation.cc:107] Waiting for socket to connect
0812 01:15:46.707055 (+ 881us) client_negotiation.cc:174] Beginning negotiation
0812 01:15:46.707196 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:15:46.708944 (+ 1748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:15:46.708945 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:15:46.708948 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:15:46.708992 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.708994 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.711056 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.711057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.713580 (+ 2523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.713584 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.714892 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.714893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.714992 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.715010 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 01:15:46.715716 (+ 706us) client_negotiation.cc:240] Negotiation successful
0812 01:15:46.715793 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1148,"thread_start_us":127,"threads_started":1}
I20260812 01:15:46.717123 7413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.704789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:36559 (local address 127.0.0.1:46106)
0812 01:15:46.706096 (+ 1307us) negotiation.cc:107] Waiting for socket to connect
0812 01:15:46.706106 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:15:46.706169 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:15:46.706720 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:15:46.706724 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:15:46.706727 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:15:46.706806 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.706808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.710594 (+ 3786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.710595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.711935 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.711938 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.716805 (+ 4867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.716807 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.716881 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.716887 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 01:15:46.716924 (+ 37us) client_negotiation.cc:240] Negotiation successful
0812 01:15:46.717044 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1291,"thread_start_us":110,"threads_started":1}
I20260812 01:15:46.717033 6771 tablet_service.cc:1467] Processing CreateTablet for tablet e5e26866f2304c03a15aa05a33bea226 (DEFAULT_TABLE table=test-table [id=9ef2bb4ef7224ebfa0258181524094c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:15:46.717465 6771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5e26866f2304c03a15aa05a33bea226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:15:46.717832 7421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.705484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46106 (local address 127.17.183.131:36559)
0812 01:15:46.706526 (+ 1042us) server_negotiation.cc:206] Beginning negotiation
0812 01:15:46.706530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:15:46.706539 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:15:46.706576 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:15:46.706578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:15:46.706592 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:15:46.707062 (+ 470us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:15:46.707172 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.710504 (+ 3332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.712077 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.716666 (+ 4589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.717600 (+ 934us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.717673 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:15:46.717704 (+ 31us) server_negotiation.cc:299] Negotiation successful
0812 01:15:46.717750 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1005,"thread_start_us":86,"threads_started":1}
I20260812 01:15:46.718303 7416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.704414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:42191 (local address 127.0.0.1:56354)
0812 01:15:46.705209 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0812 01:15:46.705257 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 01:15:46.705328 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:15:46.706889 (+ 1561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:15:46.706890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:15:46.706892 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:15:46.706987 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.706989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.713173 (+ 6184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.713174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.714352 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.714356 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.718081 (+ 3725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.718083 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.718153 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.718158 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:15:46.718191 (+ 33us) client_negotiation.cc:240] Negotiation successful
0812 01:15:46.718228 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"mutex_wait_us":1,"thread_start_us":177,"threads_started":1}
I20260812 01:15:46.718896 7414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.704861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56354 (local address 127.17.183.130:42191)
0812 01:15:46.706312 (+ 1451us) server_negotiation.cc:206] Beginning negotiation
0812 01:15:46.706316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:15:46.706326 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:15:46.706367 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:15:46.706370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:15:46.706385 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:15:46.707966 (+ 1581us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:15:46.708064 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.709340 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.714487 (+ 5147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.715738 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.718666 (+ 2928us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.718741 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 01:15:46.718770 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 01:15:46.718815 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1411,"thread_start_us":100,"threads_started":1}
I20260812 01:15:46.722229 7239 tablet_service.cc:1467] Processing CreateTablet for tablet e5e26866f2304c03a15aa05a33bea226 (DEFAULT_TABLE table=test-table [id=9ef2bb4ef7224ebfa0258181524094c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:15:46.722584 7239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5e26866f2304c03a15aa05a33bea226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:15:46.722456 6988 tablet_service.cc:1467] Processing CreateTablet for tablet e5e26866f2304c03a15aa05a33bea226 (DEFAULT_TABLE table=test-table [id=9ef2bb4ef7224ebfa0258181524094c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:15:46.722829 6988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5e26866f2304c03a15aa05a33bea226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:15:46.726982 7422 tablet_bootstrap.cc:492] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95: Bootstrap starting.
I20260812 01:15:46.727218 7423 tablet_bootstrap.cc:492] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: Bootstrap starting.
I20260812 01:15:46.728122 7422 tablet_bootstrap.cc:654] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95: Neither blocks nor log segments found. Creating new log.
I20260812 01:15:46.728688 7422 log.cc:824] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95: Log is configured to *not* fsync() on all Append() calls
I20260812 01:15:46.728724 7423 tablet_bootstrap.cc:654] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: Neither blocks nor log segments found. Creating new log.
I20260812 01:15:46.729120 7424 tablet_bootstrap.cc:492] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55: Bootstrap starting.
I20260812 01:15:46.729405 7423 log.cc:824] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: Log is configured to *not* fsync() on all Append() calls
I20260812 01:15:46.730204 7424 tablet_bootstrap.cc:654] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55: Neither blocks nor log segments found. Creating new log.
I20260812 01:15:46.730772 7424 log.cc:824] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55: Log is configured to *not* fsync() on all Append() calls
I20260812 01:15:46.731742 7422 tablet_bootstrap.cc:492] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95: No bootstrap required, opened a new log
I20260812 01:15:46.731849 7422 ts_tablet_manager.cc:1397] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 01:15:46.731907 7424 tablet_bootstrap.cc:492] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55: No bootstrap required, opened a new log
I20260812 01:15:46.731984 7424 ts_tablet_manager.cc:1397] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 01:15:46.734678 7424 raft_consensus.cc:348] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a69efe5ccf24a469fe220ea536fd06a" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42191 } } peers { permanent_uuid: "aa7a0b5039634a54b6f554b9bac96a55" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36559 } } peers { permanent_uuid: "10795f5614a843a4a31433ad6e95ea95" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37493 } }
I20260812 01:15:46.734861 7424 raft_consensus.cc:374] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:15:46.734921 7424 raft_consensus.cc:729] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa7a0b5039634a54b6f554b9bac96a55, State: Initialized, Role: FOLLOWER
I20260812 01:15:46.735059 7424 consensus_queue.cc:260] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a69efe5ccf24a469fe220ea536fd06a" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42191 } } peers { permanent_uuid: "aa7a0b5039634a54b6f554b9bac96a55" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36559 } } peers { permanent_uuid: "10795f5614a843a4a31433ad6e95ea95" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37493 } }
I20260812 01:15:46.735431 7424 ts_tablet_manager.cc:1428] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260812 01:15:46.735576 7379 heartbeater.cc:503] Master 127.17.183.190:37803 was elected leader, sending a full tablet report...
I20260812 01:15:46.735483 7422 raft_consensus.cc:348] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a69efe5ccf24a469fe220ea536fd06a" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42191 } } peers { permanent_uuid: "aa7a0b5039634a54b6f554b9bac96a55" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36559 } } peers { permanent_uuid: "10795f5614a843a4a31433ad6e95ea95" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37493 } }
I20260812 01:15:46.735692 7422 raft_consensus.cc:374] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:15:46.735771 7422 raft_consensus.cc:729] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10795f5614a843a4a31433ad6e95ea95, State: Initialized, Role: FOLLOWER
I20260812 01:15:46.735940 7422 consensus_queue.cc:260] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a69efe5ccf24a469fe220ea536fd06a" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42191 } } peers { permanent_uuid: "aa7a0b5039634a54b6f554b9bac96a55" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36559 } } peers { permanent_uuid: "10795f5614a843a4a31433ad6e95ea95" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37493 } }
I20260812 01:15:46.736609 7423 tablet_bootstrap.cc:492] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: No bootstrap required, opened a new log
I20260812 01:15:46.736744 7423 ts_tablet_manager.cc:1397] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260812 01:15:46.736829 7422 ts_tablet_manager.cc:1428] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260812 01:15:46.736946 6884 heartbeater.cc:503] Master 127.17.183.190:37803 was elected leader, sending a full tablet report...
I20260812 01:15:46.739751 7423 raft_consensus.cc:348] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a69efe5ccf24a469fe220ea536fd06a" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42191 } } peers { permanent_uuid: "aa7a0b5039634a54b6f554b9bac96a55" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36559 } } peers { permanent_uuid: "10795f5614a843a4a31433ad6e95ea95" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37493 } }
I20260812 01:15:46.739995 7423 raft_consensus.cc:374] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:15:46.740079 7423 raft_consensus.cc:729] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a69efe5ccf24a469fe220ea536fd06a, State: Initialized, Role: FOLLOWER
I20260812 01:15:46.740267 7423 consensus_queue.cc:260] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a69efe5ccf24a469fe220ea536fd06a" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42191 } } peers { permanent_uuid: "aa7a0b5039634a54b6f554b9bac96a55" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36559 } } peers { permanent_uuid: "10795f5614a843a4a31433ad6e95ea95" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37493 } }
I20260812 01:15:46.740684 7423 ts_tablet_manager.cc:1428] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260812 01:15:46.740854 7137 heartbeater.cc:503] Master 127.17.183.190:37803 was elected leader, sending a full tablet report...
Aug 12 01:15:46 dist-test-slave-rwrg krb5kdc[5642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497346, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:15:46.835549 7434 raft_consensus.cc:482] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:15:46.835731 7434 raft_consensus.cc:504] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a69efe5ccf24a469fe220ea536fd06a" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42191 } } peers { permanent_uuid: "aa7a0b5039634a54b6f554b9bac96a55" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36559 } } peers { permanent_uuid: "10795f5614a843a4a31433ad6e95ea95" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37493 } }
I20260812 01:15:46.836144 7434 leader_election.cc:288] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a69efe5ccf24a469fe220ea536fd06a (127.17.183.130:42191), aa7a0b5039634a54b6f554b9bac96a55 (127.17.183.131:36559)
I20260812 01:15:46.840291 7414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.836539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:50825 (local address 127.17.183.130:42191)
0812 01:15:46.836586 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 01:15:46.836588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:15:46.836721 (+ 133us) server_negotiation.cc:407] Connection header received
0812 01:15:46.836817 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:15:46.836818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:15:46.836828 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:15:46.836855 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:15:46.837280 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.837983 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.839410 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.839916 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.839963 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.839972 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:15:46.840184 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 01:15:46.840222 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 01:15:46.840564 7440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.836296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:42191 (local address 127.17.183.129:50825)
0812 01:15:46.836659 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 01:15:46.836670 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:15:46.836746 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:15:46.836920 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:15:46.836921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:15:46.836984 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:15:46.837166 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.837168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.838118 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.838119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.839304 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.839308 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.840041 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.840042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.840110 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.840114 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:15:46.840411 (+ 297us) client_negotiation.cc:240] Negotiation successful
0812 01:15:46.840453 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":96,"threads_started":1}
I20260812 01:15:46.840888 7041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e26866f2304c03a15aa05a33bea226" candidate_uuid: "10795f5614a843a4a31433ad6e95ea95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a69efe5ccf24a469fe220ea536fd06a" is_pre_election: true
I20260812 01:15:46.841068 7041 raft_consensus.cc:2454] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10795f5614a843a4a31433ad6e95ea95 in term 0.
I20260812 01:15:46.841300 6685 leader_election.cc:302] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10795f5614a843a4a31433ad6e95ea95, 4a69efe5ccf24a469fe220ea536fd06a; no voters:
I20260812 01:15:46.842033 7434 raft_consensus.cc:2781] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:15:46.842125 7434 raft_consensus.cc:482] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:15:46.842160 7434 raft_consensus.cc:3037] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:15:46.843287 7434 raft_consensus.cc:504] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a69efe5ccf24a469fe220ea536fd06a" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42191 } } peers { permanent_uuid: "aa7a0b5039634a54b6f554b9bac96a55" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36559 } } peers { permanent_uuid: "10795f5614a843a4a31433ad6e95ea95" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37493 } }
I20260812 01:15:46.843454 7434 leader_election.cc:288] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [CANDIDATE]: Term 1 election: Requested vote from peers 4a69efe5ccf24a469fe220ea536fd06a (127.17.183.130:42191), aa7a0b5039634a54b6f554b9bac96a55 (127.17.183.131:36559)
I20260812 01:15:46.843722 7041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e26866f2304c03a15aa05a33bea226" candidate_uuid: "10795f5614a843a4a31433ad6e95ea95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a69efe5ccf24a469fe220ea536fd06a"
I20260812 01:15:46.843803 7041 raft_consensus.cc:3037] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:15:46.844805 7041 raft_consensus.cc:2454] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10795f5614a843a4a31433ad6e95ea95 in term 1.
I20260812 01:15:46.845600 6685 leader_election.cc:302] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10795f5614a843a4a31433ad6e95ea95, 4a69efe5ccf24a469fe220ea536fd06a; no voters:
I20260812 01:15:46.845706 7434 raft_consensus.cc:2781] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:15:46.845876 7434 raft_consensus.cc:686] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [term 1 LEADER]: Becoming Leader. State: Replica: 10795f5614a843a4a31433ad6e95ea95, State: Running, Role: LEADER
I20260812 01:15:46.845988 7434 consensus_queue.cc:237] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a69efe5ccf24a469fe220ea536fd06a" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42191 } } peers { permanent_uuid: "aa7a0b5039634a54b6f554b9bac96a55" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36559 } } peers { permanent_uuid: "10795f5614a843a4a31433ad6e95ea95" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37493 } }
I20260812 01:15:46.846942 6492 catalog_manager.cc:5495] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10795f5614a843a4a31433ad6e95ea95 (127.17.183.129). New cstate: current_term: 1 leader_uuid: "10795f5614a843a4a31433ad6e95ea95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a69efe5ccf24a469fe220ea536fd06a" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa7a0b5039634a54b6f554b9bac96a55" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10795f5614a843a4a31433ad6e95ea95" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37493 } health_report { overall_health: HEALTHY } } }
I20260812 01:15:46.847718 7421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.836884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:60355 (local address 127.17.183.131:36559)
0812 01:15:46.836941 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 01:15:46.836943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:15:46.840280 (+ 3337us) server_negotiation.cc:407] Connection header received
0812 01:15:46.840800 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:15:46.840802 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:15:46.840819 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:15:46.840853 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:15:46.841098 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.841890 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.844913 (+ 3023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.845472 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.845526 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.845536 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 01:15:46.847595 (+ 2059us) server_negotiation.cc:299] Negotiation successful
0812 01:15:46.847651 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 01:15:46.847725 7442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.836412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:36559 (local address 127.17.183.129:60355)
0812 01:15:46.840201 (+ 3789us) negotiation.cc:107] Waiting for socket to connect
0812 01:15:46.840214 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:15:46.840310 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:15:46.840931 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:15:46.840932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:15:46.840935 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:15:46.841005 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.841007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.843662 (+ 2655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.843663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.844787 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:15:46.844791 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.847423 (+ 2632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.847424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:15:46.847500 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.847505 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:15:46.847582 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 01:15:46.847622 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3767,"thread_start_us":225,"threads_started":1}
I20260812 01:15:46.848426 7289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e26866f2304c03a15aa05a33bea226" candidate_uuid: "10795f5614a843a4a31433ad6e95ea95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa7a0b5039634a54b6f554b9bac96a55" is_pre_election: true
I20260812 01:15:46.848620 7289 raft_consensus.cc:2454] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10795f5614a843a4a31433ad6e95ea95 in term 0.
I20260812 01:15:46.848743 7287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e26866f2304c03a15aa05a33bea226" candidate_uuid: "10795f5614a843a4a31433ad6e95ea95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa7a0b5039634a54b6f554b9bac96a55"
I20260812 01:15:46.848809 7287 raft_consensus.cc:3037] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:15:46.849836 7287 raft_consensus.cc:2454] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10795f5614a843a4a31433ad6e95ea95 in term 1.
I20260812 01:15:46.855979 7417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.852737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34318 (local address 127.17.183.129:37493)
0812 01:15:46.852807 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 01:15:46.852809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:15:46.852819 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:15:46.852859 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:15:46.852860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:15:46.852881 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:15:46.852994 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:15:46.853162 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.853875 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.854991 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:15:46.855290 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:15:46.855359 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:15:46.855553 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:15:46.855676 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:15:46.855757 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 01:15:46.855829 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 01:15:46.855850 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:15:46.858080 7041 raft_consensus.cc:1261] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a [term 1 FOLLOWER]: Refusing update from remote peer 10795f5614a843a4a31433ad6e95ea95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:15:46.858093 7287 raft_consensus.cc:1261] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55 [term 1 FOLLOWER]: Refusing update from remote peer 10795f5614a843a4a31433ad6e95ea95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:15:46.858423 7434 consensus_queue.cc:1035] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa7a0b5039634a54b6f554b9bac96a55" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:15:46.858646 7443 consensus_queue.cc:1035] T e5e26866f2304c03a15aa05a33bea226 P 10795f5614a843a4a31433ad6e95ea95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a69efe5ccf24a469fe220ea536fd06a" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:15:46.861232 7449 mvcc.cc:205] Tried to move back new op lower bound from 7317493132728008704 to 7317493132681916416. Current Snapshot: MvccSnapshot[applied={T|T < 7317493132728008704}]
I20260812 01:15:46.861498 7450 mvcc.cc:205] Tried to move back new op lower bound from 7317493132728008704 to 7317493132681916416. Current Snapshot: MvccSnapshot[applied={T|T < 7317493132728008704}]
I20260812 01:15:46.864673 6492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:15:46.864766 6492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:15:46.865593 6492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a317e85718214df1b219c28f13c25834: Sending DeleteTablet for 3 replicas of tablet e5e26866f2304c03a15aa05a33bea226
I20260812 01:15:46.866117 6988 tablet_service.cc:1514] Processing DeleteTablet for tablet e5e26866f2304c03a15aa05a33bea226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:15:46 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:56354
I20260812 01:15:46.866441 7239 tablet_service.cc:1514] Processing DeleteTablet for tablet e5e26866f2304c03a15aa05a33bea226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:15:46 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:46106
I20260812 01:15:46.866715 6771 tablet_service.cc:1514] Processing DeleteTablet for tablet e5e26866f2304c03a15aa05a33bea226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:15:46 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:34302
I20260812 01:15:46.867491 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 6645
I20260812 01:15:46.868477 7462 tablet_replica.cc:330] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: stopping tablet replica
I20260812 01:15:46.868613 7462 raft_consensus.cc:2229] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:15:46.868664 7462 pending_rounds.cc:62] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: Trying to abort 2 pending ops.
I20260812 01:15:46.868683 7462 pending_rounds.cc:68] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317493132728008704 op_type: WRITE_OP write_request { tablet_id: "e5e26866f2304c03a15aa05a33bea226" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\356\224\357\323\006\"8\n\ntest-admin\022*\n 9ef2bb4ef7224ebfa0258181524094c7\020\001\030\001 \001(\001" signature: "<redacted>""d\377i\266S*\034\002\266\227x~\201\261\177\'\323\267\n\222\310\373\':\276\035\033\013\3749\371A\316V,\267l\357\316\002\254\374\001\262\343\017j/\257|\204A\242\"\257\307\031\376^fX\261H\315" signing_key_seq_num: 0 } } request_id { client_id: "a237db361bf647778d94d58bbe8d4ab2" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260812 01:15:46.868858 7462 pending_rounds.cc:68] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317493132681916416 op_type: NO_OP noop_request { }
I20260812 01:15:46.868886 7462 raft_consensus.cc:2866] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 01:15:46.868907 7462 raft_consensus.cc:2258] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:15:46.869079 7463 tablet_replica.cc:330] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55: stopping tablet replica
I20260812 01:15:46.869156 7463 raft_consensus.cc:2229] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:15:46.869233 7463 raft_consensus.cc:2258] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:15:46.871405 7463 ts_tablet_manager.cc:1905] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:15:46.874672 7462 ts_tablet_manager.cc:1905] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:15:46.876003 7463 ts_tablet_manager.cc:1918] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:15:46.876071 7463 log.cc:1196] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/e5e26866f2304c03a15aa05a33bea226
I20260812 01:15:46.877184 7462 ts_tablet_manager.cc:1918] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:15:46.877250 7462 log.cc:1196] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/e5e26866f2304c03a15aa05a33bea226
I20260812 01:15:46.877458 7462 ts_tablet_manager.cc:1939] T e5e26866f2304c03a15aa05a33bea226 P 4a69efe5ccf24a469fe220ea536fd06a: Deleting consensus metadata
I20260812 01:15:46.877846 7463 ts_tablet_manager.cc:1939] T e5e26866f2304c03a15aa05a33bea226 P aa7a0b5039634a54b6f554b9bac96a55: Deleting consensus metadata
I20260812 01:15:46.878435 6459 catalog_manager.cc:4841] TS aa7a0b5039634a54b6f554b9bac96a55 (127.17.183.131:36559): tablet e5e26866f2304c03a15aa05a33bea226 (table test-table [id=9ef2bb4ef7224ebfa0258181524094c7]) successfully deleted
I20260812 01:15:46.878928 6465 catalog_manager.cc:4841] TS 4a69efe5ccf24a469fe220ea536fd06a (127.17.183.130:42191): tablet e5e26866f2304c03a15aa05a33bea226 (table test-table [id=9ef2bb4ef7224ebfa0258181524094c7]) successfully deleted
W20260812 01:15:46.885697 6459 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:37493 (error 108)
I20260812 01:15:46.885743 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 6895
I20260812 01:15:46.896054 7410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:15:46.895896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:37493 (local address 127.0.0.1:34330)
0812 01:15:46.895958 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 01:15:46.896007 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:37493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 01:15:46.896225 6459 catalog_manager.cc:4584] TS 10795f5614a843a4a31433ad6e95ea95 (127.17.183.129:37493): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e5e26866f2304c03a15aa05a33bea226: Network error: Client connection negotiation failed: client connection to 127.17.183.129:37493: connect: Connection refused (error 111)
I20260812 01:15:46.901127 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 7142
I20260812 01:15:46.914175 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 6431
I20260812 01:15:46.926487 18142 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 01:15:47.284036 18142 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 01:15:47.284144 18142 mini_ranger.cc:66] Stopping Ranger...
I20260812 01:15:47.639611 18142 mini_ranger.cc:68] Stopped Ranger
2026-08-12 01:15:47.639 UTC [5700] LOG: received smart shutdown request
2026-08-12 01:15:47.643 UTC [5700] LOG: background worker "logical replication launcher" (PID 5712) exited with exit code 1
2026-08-12 01:15:47.644 UTC [5706] LOG: shutting down
2026-08-12 01:15:47.823 UTC [5700] LOG: database system is shut down
2026-08-12T01:15:47Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50666 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:15:47 dist-test-slave-rwrg krb5kdc[7484](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:15:47 dist-test-slave-rwrg krb5kdc[7484](info): set up 2 sockets
Aug 12 01:15:47 dist-test-slave-rwrg krb5kdc[7484](info): commencing operation
krb5kdc: starting...
W20260812 01:15:49.220539 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:15:49 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:15:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:15:49Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.183.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.183.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/rangeradmin_127.17.183.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/rangeradmin_127.17.183.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.183.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.183.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/rangerlookup_127.17.183.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/rangerlookup_127.17.183.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.183.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.183.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/HTTP_127.17.183.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/HTTP_127.17.183.148@KRBTEST.COM.keytab.
I20260812 01:15:49.383234 18142 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskog5hhV/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/postgres -l logfile start
2026-08-12 01:15:51.793 UTC [7542] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 01:15:51.793 UTC [7542] LOG: listening on IPv4 address "127.17.183.148", port 49239
2026-08-12 01:15:51.797 UTC [7542] LOG: listening on Unix socket "/tmp/.s.PGSQL.49239"
2026-08-12 01:15:51.818 UTC [7545] LOG: database system was shut down at 2026-08-12 01:15:50 UTC
2026-08-12 01:15:51.821 UTC [7542] LOG: database system is ready to accept connections
I20260812 01:15:53.042433 18142 mini_postgres.cc:96] Postgres bound to 49239
2026-08-12 01:15:53.049 UTC [7560] FATAL: database "slave" does not exist
127.17.183.148:49239 - accepting connections
I20260812 01:15:53.050275 18142 mini_ranger.cc:161] Starting Ranger...
I20260812 01:15:53.065696 18142 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 01:15:53.514679 18142 mini_ranger.cc:87] Created ranger Postgres database
I20260812 01:15:53.514751 18142 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-admin
2026-08-12 01:15:53,810 [I] DB FLAVOR :POSTGRES
2026-08-12 01:15:53,811 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 01:15:53,811 [I] Checking connection..
2026-08-12 01:15:53,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 01:15:54,052 [I] Checking connection passed.
2026-08-12 01:15:54,053 [I] --------- Verifying version history table ---------
2026-08-12 01:15:54,053 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:15:54,324 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 01:15:54,325 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:15:54,595 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 01:15:54,596 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 01:15:54,596 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 01:15:54.839 UTC [7716] WARNING: there is no transaction in progress
2026-08-12 01:15:54,847 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 01:15:54,847 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:15:55,111 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 01:15:55,111 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 01:15:55,111 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 01:15:55,381 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 01:15:55,644 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-rwrg.c.gcp-upstream.internal','N') ;"
2026-08-12 01:15:55,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 01:15:56,157 [I] Table x_portal_user does not exist in database ranger
2026-08-12 01:15:56,157 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 01:15:56,425 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 01:15:56,426 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 01:15:56,683 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 01:15:56,952 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 01:15:56,953 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 01:15:57.913 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:57.929 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:57.945 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:57.960 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:57.975 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:57.992 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:58.045 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:58.052 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:58.067 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:58.077 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:58.088 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:58.102 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:58.111 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:58.118 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:58.124 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:58.130 UTC [7901] WARNING: there is no transaction in progress
2026-08-12 01:15:58,760 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 01:15:58,760 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 01:15:59,012 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 01:15:59,013 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 01:15:59,289 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 01:15:59,289 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 01:15:59,554 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 01:15:59,555 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 01:15:59,819 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 01:16:00,091 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-rwrg.c.gcp-upstream.internal';"
2026-08-12 01:16:00,355 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 01:16:00,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 01:16:00,590 [I] DB_PATCHES have already been applied
I20260812 01:16:00.596397 18142 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-admin:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskog5hhV/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 01:16:00.596475 18142 mini_ranger.cc:193] Using host: 127.17.183.148
I20260812 01:16:00.600766 18142 mini_ranger.cc:227] Ranger admin URL: http://127.17.183.148:56515
Aug 12, 2026 1:16:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 1:16:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 1:16:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 1:16:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 1:16:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 1:16:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 1:16:01 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 01:16:02.047652 18142 mini_ranger.cc:160] Time spent starting Ranger: real 8.997s user 0.008s sys 0.003s
Aug 12, 2026 1:16:22 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 1:16:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 12, 2026 1:16:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 1:16:22 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 1:16:23 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 01:16:23.903587 18142 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.183.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.183.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/rangerkms_127.17.183.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.183.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/rangerkms_127.17.183.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.183.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.183.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.183.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/HTTP_127.17.183.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.183.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/HTTP_127.17.183.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 01:16:23 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497383, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 01:16:24.010716 18142 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 01:16:24.020730 18142 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 01:16:24.866607 18142 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 01:16:24.866698 18142 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-kms
I20260812 01:16:24.866715 18142 mini_ranger_kms.cc:227] Using postgres at 127.17.183.148:49239
2026-08-12 01:16:25,058 [I] DB FLAVOR :POSTGRES
2026-08-12 01:16:25,059 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 01:16:25,059 [I] Checking connection
2026-08-12 01:16:25,059 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 01:16:25,304 [I] connection success
2026-08-12 01:16:25,305 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 01:16:25,305 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 01:16:25,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 01:16:25,547 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 01:16:25,548 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 01:16:25,548 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 01:16:25,548 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.183.148:49239/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 01:16:25,817 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 01:16:26.306622 18142 mini_ranger_kms.cc:310] Created kms service
I20260812 01:16:26.523911 18142 mini_ranger_kms.cc:326] Created kudu user
I20260812 01:16:26.568087 18142 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 01:16:26 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497383, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:16:26.991705 18142 mini_ranger_kms.cc:384] Added ranger policy
I20260812 01:16:26.991925 18142 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-kms:/tmp/dist-test-taskog5hhV/build/release/bin/postgresql.jar:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskog5hhV/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 01:16:26.991946 18142 mini_ranger_kms.cc:240] Using host: 127.17.183.148
I20260812 01:16:26.996444 18142 mini_ranger_kms.cc:276] Ranger KMS PID: 8266
I20260812 01:16:26.996551 18142 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.183.148:53863
Aug 12, 2026 1:16:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 1:16:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 1:16:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 1:16:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 1:16:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 1:16:28 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 01:16:29 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786497389, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.183.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:29.827440 18142 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.817s user 0.014s sys 0.161s
I20260812 01:16:29.827554 18142 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 01:16:29.827601 18142 mini_ranger_kms.cc:401] 127.17.183.148:53863/kms/v1/keys
Aug 12 01:16:30 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497389, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.183.148@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
Aug 12 01:16:30 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497389, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.183.148@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
Aug 12 01:16:32 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:16:32.905089 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:36981
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:36981
--ranger_config_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:53863/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:32.989501 8364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:32.989755 8364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:32.989794 8364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:32.990962 8364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:16:32.991029 8364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:32.991051 8364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:32.991073 8364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:16:32.991132 8364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:16:32.992765 8364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.183.148:53863/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:36981
--ranger_config_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:36981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:32.993057 8364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:32.993296 8364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:32.998220 8372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:32.998216 8374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:32.998301 8376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:32.998387 8364 server_base.cc:1034] running on GCE node
I20260812 01:16:32.998782 8364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:32.999100 8364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:33.000259 8364 hybrid_clock.cc:648] HybridClock initialized: now 1786497393000227 us; error 49 us; skew 500 ppm
Aug 12 01:16:33 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497393, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:33.006024 8364 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:16:33.006493 8364 webserver.cc:460] Webserver started at http://127.17.183.190:38889/ using document root <none> and password file <none>
I20260812 01:16:33.006742 8364 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:33.006779 8364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:33.006872 8364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:16:33 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497393, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:16:33.054858 8364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "e2d66899dc554041876631f23d709e60"
format_stamp: "Formatted at 2026-08-12 01:16:33 on dist-test-slave-rwrg"
server_key: "88bf5325a6d199ab885fc36a0db309c5"
server_key_iv: "ff780ad830a0eff46b762094c133a7b8"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:33.055337 8364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "e2d66899dc554041876631f23d709e60"
format_stamp: "Formatted at 2026-08-12 01:16:33 on dist-test-slave-rwrg"
server_key: "88bf5325a6d199ab885fc36a0db309c5"
server_key_iv: "ff780ad830a0eff46b762094c133a7b8"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:33.057117 8364 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 01:16:33.072311 8387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:33.072592 8364 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 01:16:33.072690 8364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "e2d66899dc554041876631f23d709e60"
format_stamp: "Formatted at 2026-08-12 01:16:33 on dist-test-slave-rwrg"
server_key: "88bf5325a6d199ab885fc36a0db309c5"
server_key_iv: "ff780ad830a0eff46b762094c133a7b8"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:33.072784 8364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:33.089438 8364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:33.091713 8364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:33.091869 8364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:33.097184 8364 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:36981
I20260812 01:16:33.097271 8487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:36981 every 8 connection(s)
I20260812 01:16:33.097649 8364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:16:33.098388 8489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:33.100791 8489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60: Bootstrap starting.
I20260812 01:16:33.101087 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 8364
I20260812 01:16:33.101222 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:16:33.101456 18142 external_mini_cluster.cc:1428] Setting key a295790f8cfbb381a275e940279923ef
I20260812 01:16:33.102460 8489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:33.102819 8489 log.cc:824] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:33.103542 8489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60: No bootstrap required, opened a new log
I20260812 01:16:33.105479 8489 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } }
I20260812 01:16:33.105644 8489 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:33.105671 8489 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d66899dc554041876631f23d709e60, State: Initialized, Role: FOLLOWER
I20260812 01:16:33.105801 8489 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } }
I20260812 01:16:33.105881 8489 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:16:33.105906 8489 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:16:33.105973 8489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:33.106498 8489 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } }
I20260812 01:16:33.106637 8489 leader_election.cc:302] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2d66899dc554041876631f23d709e60; no voters:
I20260812 01:16:33.106814 8489 leader_election.cc:288] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:16:33.106861 8509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:16:33.107077 8509 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 1 LEADER]: Becoming Leader. State: Replica: e2d66899dc554041876631f23d709e60, State: Running, Role: LEADER
I20260812 01:16:33.107115 8489 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:16:33.107270 8509 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } }
I20260812 01:16:33.107684 8509 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2d66899dc554041876631f23d709e60. Latest consensus state: current_term: 1 leader_uuid: "e2d66899dc554041876631f23d709e60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } } }
I20260812 01:16:33.107697 8511 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2d66899dc554041876631f23d709e60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } } }
I20260812 01:16:33.107870 8509 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:33.107884 8511 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:33.108381 8523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 01:16:33 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:33.108994 8523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:16:33.109418 8489 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 01:16:33.114493 8523 catalog_manager.cc:1347] Generated new cluster ID: 742081a8759045f083ad77347139209c
I20260812 01:16:33.114559 8523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:16:33.116715 8504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:33.102089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38184 (local address 127.17.183.190:36981)
0812 01:16:33.102323 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:33.102333 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:33.102370 (+ 37us) server_negotiation.cc:407] Connection header received
0812 01:16:33.102982 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:33.102994 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:33.103060 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:33.103229 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:33.103974 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:33.104931 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:33.105801 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:33.106342 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:33.106470 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:33.109617 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:33.109622 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:33.109622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:33.109636 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:33.114735 (+ 5099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:33.115133 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:33.115136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:33.115136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:33.115237 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:33.115420 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:33.115421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:33.115421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:33.115707 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:33.115858 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:33.116332 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 01:16:33.116471 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":101,"threads_started":1}
I20260812 01:16:33.128381 8523 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:16:33.129155 8523 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:16:33.139156 8523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60: Generated new TSK 0
I20260812 01:16:33.139353 8523 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:16:33.841809 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:53863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36981
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:33.958257 8591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:33.958501 8591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:33.958539 8591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:33.960204 8591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:33.960271 8591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:33.960312 8591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:16:33.962692 8591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.183.148:53863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:33.962953 8591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:33.963321 8591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:33.969795 8608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:33.970207 8610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:33.970603 8591 server_base.cc:1034] running on GCE node
W20260812 01:16:33.970368 8604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:33.970890 8591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:33.971161 8591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:33.972319 8591 hybrid_clock.cc:648] HybridClock initialized: now 1786497393972275 us; error 61 us; skew 500 ppm
Aug 12 01:16:33 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497393, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:33.974975 8591 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:16:33.975443 8591 webserver.cc:460] Webserver started at http://127.17.183.129:37523/ using document root <none> and password file <none>
I20260812 01:16:33.975696 8591 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:33.975767 8591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:33.975929 8591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:16:33 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497393, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:16:33.991643 8591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "376f50796e364da89a92662a357431b6"
format_stamp: "Formatted at 2026-08-12 01:16:33 on dist-test-slave-rwrg"
server_key: "8fdbf0a80c85bdf584aee8db426c9696"
server_key_iv: "fe784cda7103130839d9d80a5ca3eb7e"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:33.992177 8591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "376f50796e364da89a92662a357431b6"
format_stamp: "Formatted at 2026-08-12 01:16:33 on dist-test-slave-rwrg"
server_key: "8fdbf0a80c85bdf584aee8db426c9696"
server_key_iv: "fe784cda7103130839d9d80a5ca3eb7e"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:33.994228 8591 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 01:16:34.007375 8621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:34.007638 8591 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:34.007742 8591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "376f50796e364da89a92662a357431b6"
format_stamp: "Formatted at 2026-08-12 01:16:33 on dist-test-slave-rwrg"
server_key: "8fdbf0a80c85bdf584aee8db426c9696"
server_key_iv: "fe784cda7103130839d9d80a5ca3eb7e"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:34.007831 8591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:34.023377 8591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:34.025508 8591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:34.025678 8591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:34.025910 8591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:34.026254 8591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:34.026310 8591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:34.026355 8591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:34.026381 8591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:34.033913 8591 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:38165
I20260812 01:16:34.034032 8864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:38165 every 8 connection(s)
I20260812 01:16:34.034394 8591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:16:34.042867 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 8591
I20260812 01:16:34.042980 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:16:34.043244 18142 external_mini_cluster.cc:1428] Setting key a5f1da8226af97dfae84c2f16846bcbc
Aug 12 01:16:34 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497393, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:34.049225 8873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:34.035236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:40839 (local address 127.17.183.190:36981)
0812 01:16:34.035390 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:34.035393 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:34.035621 (+ 228us) server_negotiation.cc:407] Connection header received
0812 01:16:34.036380 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:34.036382 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:34.036396 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:34.036442 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:34.037430 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.040586 (+ 3156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.042136 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.042484 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.042528 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:34.045822 (+ 3294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:34.045823 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:34.045824 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:34.045832 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:34.047603 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:34.048103 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:34.048104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:34.048105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:34.048170 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:34.048451 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:34.048452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:34.048452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:34.048604 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:34.048645 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:34.049017 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 01:16:34.049119 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":84,"threads_started":1}
I20260812 01:16:34.049767 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:34.035197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36981 (local address 127.17.183.129:40839)
0812 01:16:34.035481 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:34.035531 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:34.036245 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:34.036675 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:34.036680 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:34.036967 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:34.037313 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:34.037321 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.040712 (+ 3391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.040713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:34.042004 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:34.042007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.042636 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.042637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:34.042788 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:34.043954 (+ 1166us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:34.043964 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:34.045706 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:34.047698 (+ 1992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:34.047706 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:34.047709 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:34.047999 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:34.048247 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:34.048247 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:34.048248 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:34.048376 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:34.048692 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:34.048700 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:34.048865 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 01:16:34.049376 (+ 511us) client_negotiation.cc:240] Negotiation successful
0812 01:16:34.049534 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":96,"threads_started":1}
I20260812 01:16:34.050240 8865 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36981
I20260812 01:16:34.050350 8865 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:34.050570 8865 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
I20260812 01:16:34.051182 8422 ts_manager.cc:194] Registered new tserver with Master: 376f50796e364da89a92662a357431b6 (127.17.183.129:38165)
I20260812 01:16:34.052091 8422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:40839
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:16:34.090834 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:53863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36981
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:16:34 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786497394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 01:16:34.210959 8880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:34.211172 8880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:34.211205 8880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:34.212316 8880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:34.212395 8880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:34.212450 8880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:16:34.213879 8880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.183.148:53863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:34.214148 8880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:34.214390 8880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:34.220142 8901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:34.220151 8897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:34.220115 8894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:34.220791 8880 server_base.cc:1034] running on GCE node
I20260812 01:16:34.221027 8880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:34.221362 8880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:34.222597 8880 hybrid_clock.cc:648] HybridClock initialized: now 1786497394222574 us; error 38 us; skew 500 ppm
Aug 12 01:16:34 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:34.225600 8880 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:16:34.226106 8880 webserver.cc:460] Webserver started at http://127.17.183.130:32859/ using document root <none> and password file <none>
I20260812 01:16:34.226402 8880 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:34.226486 8880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:34.226621 8880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:16:34 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:16:34.246555 8880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "bb5efba41e0a438e92daec772b8fb9c3"
format_stamp: "Formatted at 2026-08-12 01:16:34 on dist-test-slave-rwrg"
server_key: "5d4b44fa9c5d3270716d8c6fe5dce443"
server_key_iv: "3ae049af31bcab0f61893ebe86faf69e"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:34.246978 8880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "bb5efba41e0a438e92daec772b8fb9c3"
format_stamp: "Formatted at 2026-08-12 01:16:34 on dist-test-slave-rwrg"
server_key: "5d4b44fa9c5d3270716d8c6fe5dce443"
server_key_iv: "3ae049af31bcab0f61893ebe86faf69e"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:34.252758 8880 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.000s
I20260812 01:16:34.266119 8916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:34.266335 8880 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:16:34.266435 8880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "bb5efba41e0a438e92daec772b8fb9c3"
format_stamp: "Formatted at 2026-08-12 01:16:34 on dist-test-slave-rwrg"
server_key: "5d4b44fa9c5d3270716d8c6fe5dce443"
server_key_iv: "3ae049af31bcab0f61893ebe86faf69e"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:34.266518 8880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:34.278563 8880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:34.280941 8880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:34.281092 8880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:34.281311 8880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:34.281661 8880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:34.281703 8880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:34.281733 8880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:34.281752 8880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:34.289742 8880 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:46261
I20260812 01:16:34.289907 9119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:46261 every 8 connection(s)
I20260812 01:16:34.290202 8880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:16:34.293320 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 8880
I20260812 01:16:34.293417 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:16:34.293627 18142 external_mini_cluster.cc:1428] Setting key 77616ed0b677185a5b47a645cff6ce69
Aug 12 01:16:34 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:34.303352 9123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:34.291056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36981 (local address 127.17.183.130:44759)
0812 01:16:34.292701 (+ 1645us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:34.292754 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:34.293448 (+ 694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:34.293879 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:34.293884 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:34.294138 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:34.294421 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:34.294429 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.295433 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.295434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:34.296716 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:34.296719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.297298 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.297299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:34.297444 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:34.297976 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:34.297987 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:34.299758 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:34.301723 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:34.301732 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:34.301735 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:34.302036 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:34.302267 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:34.302268 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:34.302268 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:34.302399 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:34.302707 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:34.302715 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:34.302872 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 01:16:34.302976 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 01:16:34.303122 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1578,"thread_start_us":85,"threads_started":1}
I20260812 01:16:34.303862 8873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:34.291096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:44759 (local address 127.17.183.190:36981)
0812 01:16:34.291143 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:34.291145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:34.292875 (+ 1730us) server_negotiation.cc:407] Connection header received
0812 01:16:34.293614 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:34.293617 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:34.293634 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:34.293667 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:34.294544 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.295309 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.296823 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.297140 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.297187 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:34.299872 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:34.299873 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:34.299874 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:34.299881 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:34.301621 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:34.302133 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:34.302134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:34.302135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:34.302198 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:34.302469 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:34.302470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:34.302471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:34.302619 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:34.302679 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:34.303676 (+ 997us) server_negotiation.cc:299] Negotiation successful
0812 01:16:34.303771 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:16:34.304271 9121 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36981
I20260812 01:16:34.304373 9121 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:34.304605 9121 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
I20260812 01:16:34.304981 8422 ts_manager.cc:194] Registered new tserver with Master: bb5efba41e0a438e92daec772b8fb9c3 (127.17.183.130:46261)
I20260812 01:16:34.305438 8422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:44759
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:16:34.337936 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:53863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36981
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:34.456700 9129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:34.457021 9129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:34.457067 9129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:34.458490 9129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:34.458562 9129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:34.458613 9129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:16:34.460626 9129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.183.148:53863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:34.460968 9129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:34.461225 9129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:34.470054 9138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:34.470358 9137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:34.470498 9147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:34.472158 9129 server_base.cc:1034] running on GCE node
I20260812 01:16:34.472415 9129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:34.472759 9129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:34.474020 9129 hybrid_clock.cc:648] HybridClock initialized: now 1786497394473986 us; error 36 us; skew 500 ppm
Aug 12 01:16:34 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:34.477125 9129 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:16:34.477612 9129 webserver.cc:460] Webserver started at http://127.17.183.131:38923/ using document root <none> and password file <none>
I20260812 01:16:34.477896 9129 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:34.477965 9129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:34.478116 9129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:16:34 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:16:34.495798 9129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "4314e01ff61246f8921d7c56236cc5e8"
format_stamp: "Formatted at 2026-08-12 01:16:34 on dist-test-slave-rwrg"
server_key: "ebf22363348fa7dcde98014c225aba8e"
server_key_iv: "30d1b8656f785d63c3ad62904231a241"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:34.496321 9129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "4314e01ff61246f8921d7c56236cc5e8"
format_stamp: "Formatted at 2026-08-12 01:16:34 on dist-test-slave-rwrg"
server_key: "ebf22363348fa7dcde98014c225aba8e"
server_key_iv: "30d1b8656f785d63c3ad62904231a241"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:34.500715 9129 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.001s
I20260812 01:16:34.518606 9160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:34.518857 9129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260812 01:16:34.518949 9129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "4314e01ff61246f8921d7c56236cc5e8"
format_stamp: "Formatted at 2026-08-12 01:16:34 on dist-test-slave-rwrg"
server_key: "ebf22363348fa7dcde98014c225aba8e"
server_key_iv: "30d1b8656f785d63c3ad62904231a241"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:34.519043 9129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:34.574484 9129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:34.577167 9129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:34.577406 9129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:34.577703 9129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:34.578215 9129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:34.578327 9129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:34.578402 9129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:34.578460 9129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:34.588495 9129 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:36455
I20260812 01:16:34.589015 9129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:16:34.590205 9345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:36455 every 8 connection(s)
I20260812 01:16:34.594036 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 9129
I20260812 01:16:34.594138 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:16:34.594309 18142 external_mini_cluster.cc:1428] Setting key c1d809491ea58df6f4b22b66087090a4
Aug 12 01:16:34 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:34.607945 8873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:34.591083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:34069 (local address 127.17.183.190:36981)
0812 01:16:34.591134 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:34.591137 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:34.591401 (+ 264us) server_negotiation.cc:407] Connection header received
0812 01:16:34.592061 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:34.592062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:34.592074 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:34.592135 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:34.592926 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.593736 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.595424 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.595699 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.595766 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:34.598341 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:34.598342 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:34.598343 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:34.598350 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:34.599959 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:34.600390 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:34.600391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:34.600392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:34.600464 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:34.607097 (+ 6633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:34.607098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:34.607099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:34.607258 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:34.607336 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:34.607723 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 01:16:34.607821 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 01:16:34.608574 9350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:34.591059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36981 (local address 127.17.183.131:34069)
0812 01:16:34.591231 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:34.591285 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:34.591942 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:34.592223 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:34.592227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:34.592474 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:34.592782 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:34.592790 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.593873 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.593874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:34.595336 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:34.595339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:34.595813 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:34.595814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:34.595957 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:34.596582 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:34.596592 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:34.598220 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:34.600059 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:34.600066 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:34.600068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:34.600325 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:34.606811 (+ 6486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:34.606812 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:34.606813 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:34.606985 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:34.607368 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:34.607377 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:34.607545 (+ 168us) client_negotiation.cc:769] Sending connection context
0812 01:16:34.608100 (+ 555us) client_negotiation.cc:240] Negotiation successful
0812 01:16:34.608292 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260812 01:16:34.609025 9347 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36981
I20260812 01:16:34.609181 9347 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:34.609385 9347 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
I20260812 01:16:34.609793 8422 ts_manager.cc:194] Registered new tserver with Master: 4314e01ff61246f8921d7c56236cc5e8 (127.17.183.131:36455)
I20260812 01:16:34.610291 8422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:34069
I20260812 01:16:34.616679 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:16:34.617450 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 8591
Aug 12 01:16:34 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:16:34.635790 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 8880
I20260812 01:16:34.643487 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 9129
I20260812 01:16:34.656811 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 8364
I20260812 01:16:34.675451 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:36981
--webserver_interface=127.17.183.190
--webserver_port=38889
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:36981
--ranger_config_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:53863/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.183.148:53863/kms with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:34.782436 9355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:34.782634 9355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:34.782655 9355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:34.783746 9355 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:16:34.783784 9355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:34.783797 9355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:34.783809 9355 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:16:34.783821 9355 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:16:34.785452 9355 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.183.148:53863/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:36981
--ranger_config_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:36981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=38889
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:34.785708 9355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:34.785941 9355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:34.791980 9363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:34.791952 9365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:34.792105 9355 server_base.cc:1034] running on GCE node
W20260812 01:16:34.791955 9367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:34.792447 9355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:34.792791 9355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:34.793975 9355 hybrid_clock.cc:648] HybridClock initialized: now 1786497394793952 us; error 41 us; skew 500 ppm
Aug 12 01:16:34 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:34.796602 9355 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:16:34.797106 9355 webserver.cc:460] Webserver started at http://127.17.183.190:38889/ using document root <none> and password file <none>
I20260812 01:16:34.797343 9355 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:34.797410 9355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 01:16:34 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:16:34.869490 9355 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:34.870393 9386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:34.870616 9355 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:34.870726 9355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "e2d66899dc554041876631f23d709e60"
format_stamp: "Formatted at 2026-08-12 01:16:33 on dist-test-slave-rwrg"
server_key: "88bf5325a6d199ab885fc36a0db309c5"
server_key_iv: "ff780ad830a0eff46b762094c133a7b8"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:34.871196 9355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:34.890894 9355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:34.893095 9355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:34.893253 9355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:34.898566 9355 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:36981
I20260812 01:16:34.898595 9476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:36981 every 8 connection(s)
I20260812 01:16:34.899075 9355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:16:34.900372 9479 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:16:34.901073 9479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60: Bootstrap starting.
I20260812 01:16:34.903390 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 9355
I20260812 01:16:34.903785 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:53863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:38165
--local_ip_for_outbound_sockets=127.17.183.129
--tserver_master_addrs=127.17.183.190:36981
--webserver_port=37523
--webserver_interface=127.17.183.129
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.183.148:53863/kms with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:16:34.910429 9479 log.cc:824] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:34.912184 9479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:16:34.912545 9479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60: Bootstrap complete.
I20260812 01:16:34.915052 9479 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } }
I20260812 01:16:34.915313 9479 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d66899dc554041876631f23d709e60, State: Initialized, Role: FOLLOWER
I20260812 01:16:34.915521 9479 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } }
I20260812 01:16:34.915606 9479 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:16:34.915666 9479 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:16:34.915702 9479 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:16:34.916817 9479 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } }
I20260812 01:16:34.916939 9479 leader_election.cc:302] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2d66899dc554041876631f23d709e60; no voters:
I20260812 01:16:34.917161 9479 leader_election.cc:288] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 01:16:34.917196 9485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 01:16:34.917644 9485 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [term 2 LEADER]: Becoming Leader. State: Replica: e2d66899dc554041876631f23d709e60, State: Running, Role: LEADER
I20260812 01:16:34.917666 9479 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:16:34.919030 9485 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } }
I20260812 01:16:34.919627 9487 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e2d66899dc554041876631f23d709e60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } } }
I20260812 01:16:34.919703 9487 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:34.919838 9479 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 01:16:34.919953 9488 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2d66899dc554041876631f23d709e60. Latest consensus state: current_term: 2 leader_uuid: "e2d66899dc554041876631f23d709e60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d66899dc554041876631f23d709e60" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36981 } } }
I20260812 01:16:34.920006 9488 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:34.923143 9504 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:16:34.923959 9504 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:16:34.924190 9504 catalog_manager.cc:1259] Loaded cluster ID: 742081a8759045f083ad77347139209c
I20260812 01:16:34.924268 9504 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:16:34.925846 9504 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:16:34.926097 9504 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60: Loaded TSK: 0
I20260812 01:16:34.926368 9504 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 01:16:35.026890 9481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:35.027166 9481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:35.027202 9481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:35.028906 9481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:35.028959 9481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:35.028999 9481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:16:35.031108 9481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.183.148:53863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:38165
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=37523
--tserver_master_addrs=127.17.183.190:36981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:35.031378 9481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:35.031636 9481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:35.038127 9532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:35.038699 9530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:35.039417 9481 server_base.cc:1034] running on GCE node
W20260812 01:16:35.039651 9542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:35.039891 9481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:35.040159 9481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:35.041344 9481 hybrid_clock.cc:648] HybridClock initialized: now 1786497395041327 us; error 28 us; skew 500 ppm
Aug 12 01:16:35 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:35.044524 9481 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:16:35.045013 9481 webserver.cc:460] Webserver started at http://127.17.183.129:37523/ using document root <none> and password file <none>
I20260812 01:16:35.045254 9481 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:35.045322 9481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 01:16:35 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:16:35.070086 9481 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 01:16:35.071360 9565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:35.071573 9481 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 01:16:35.071657 9481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "376f50796e364da89a92662a357431b6"
format_stamp: "Formatted at 2026-08-12 01:16:33 on dist-test-slave-rwrg"
server_key: "8fdbf0a80c85bdf584aee8db426c9696"
server_key_iv: "fe784cda7103130839d9d80a5ca3eb7e"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:35.072120 9481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:35.085197 9481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:35.087682 9481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:35.087896 9481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:35.088152 9481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:35.088644 9481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:35.088758 9481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:35.088865 9481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:35.088938 9481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:35.095352 9481 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:38165
I20260812 01:16:35.095897 9481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:16:35.097043 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 9481
I20260812 01:16:35.097354 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:53863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:46261
--local_ip_for_outbound_sockets=127.17.183.130
--tserver_master_addrs=127.17.183.190:36981
--webserver_port=32859
--webserver_interface=127.17.183.130
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.183.148:53863/kms with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:16:35.101475 9769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:38165 every 8 connection(s)
Aug 12 01:16:35 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:35.116365 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:35.103601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36981 (local address 127.17.183.129:40251)
0812 01:16:35.104303 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:35.104347 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:35.104973 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:35.105716 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:35.105720 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:35.105939 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:35.106180 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:35.106185 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.107708 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.107709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:35.108903 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:35.108906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.109841 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.109842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:35.109963 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:35.110579 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:35.110600 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:35.112339 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:35.114620 (+ 2281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:35.114627 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:35.114629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:35.114901 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:35.115184 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:35.115185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:35.115185 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:35.115299 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:35.115732 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:35.115750 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:35.115885 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 01:16:35.115982 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 01:16:35.116122 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":86,"threads_started":1}
I20260812 01:16:35.117173 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:35.103965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:40251 (local address 127.17.183.190:36981)
0812 01:16:35.105175 (+ 1210us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:35.105185 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:35.105216 (+ 31us) server_negotiation.cc:407] Connection header received
0812 01:16:35.105380 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:35.105385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:35.105434 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:35.105578 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:35.106337 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.107590 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.109002 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.109619 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.109717 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:35.112474 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:35.112479 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:35.112479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:35.112490 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:35.114527 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:35.114990 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:35.114993 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:35.114993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:35.115116 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:35.115365 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:35.115366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:35.115366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:35.115632 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:35.115704 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:35.116841 (+ 1137us) server_negotiation.cc:299] Negotiation successful
0812 01:16:35.116961 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1157,"thread_start_us":76,"threads_started":1}
I20260812 01:16:35.118980 9770 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36981
I20260812 01:16:35.119071 9770 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:35.119251 9770 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
W20260812 01:16:35.120163 9770 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:36981 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 01:16:35.120230 9770 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:35.120286 9770 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
I20260812 01:16:35.120720 9770 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:35.120816 9770 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
W20260812 01:16:35.121152 9770 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 01:16:35.233536 9773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:35.233814 9773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:35.233867 9773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:35.235184 9773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:35.235277 9773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:35.235321 9773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:16:35.237025 9773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.183.148:53863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:46261
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=32859
--tserver_master_addrs=127.17.183.190:36981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:35.237270 9773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:35.237531 9773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:35.244020 9788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:35.244277 9773 server_base.cc:1034] running on GCE node
W20260812 01:16:35.244617 9791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:35.244844 9787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:35.245141 9773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:35.245414 9773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:35.246572 9773 hybrid_clock.cc:648] HybridClock initialized: now 1786497395246538 us; error 47 us; skew 500 ppm
Aug 12 01:16:35 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:35.249423 9773 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:16:35.249965 9773 webserver.cc:460] Webserver started at http://127.17.183.130:32859/ using document root <none> and password file <none>
I20260812 01:16:35.250218 9773 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:35.250310 9773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 01:16:35 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:16:35.290896 9773 fs_manager.cc:709] Time spent opening directory manager: real 0.023s user 0.001s sys 0.000s
I20260812 01:16:35.292975 9804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:35.293234 9773 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 01:16:35.293349 9773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "bb5efba41e0a438e92daec772b8fb9c3"
format_stamp: "Formatted at 2026-08-12 01:16:34 on dist-test-slave-rwrg"
server_key: "5d4b44fa9c5d3270716d8c6fe5dce443"
server_key_iv: "3ae049af31bcab0f61893ebe86faf69e"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:35.293865 9773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:35.310916 9773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:35.313259 9773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:35.313438 9773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:35.313702 9773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:35.314090 9773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:35.314152 9773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:35.314183 9773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:35.314209 9773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:35.322135 9773 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:46261
I20260812 01:16:35.322641 9773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:16:35.323556 10021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:46261 every 8 connection(s)
Aug 12 01:16:35 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:35.332091 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 9773
I20260812 01:16:35.332471 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.183.148:53863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:36455
--local_ip_for_outbound_sockets=127.17.183.131
--tserver_master_addrs=127.17.183.190:36981
--webserver_port=38923
--webserver_interface=127.17.183.131
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.183.148:53863/kms with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:16:35.334263 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:35.323722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:34553 (local address 127.17.183.190:36981)
0812 01:16:35.323815 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:35.323817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:35.324799 (+ 982us) server_negotiation.cc:407] Connection header received
0812 01:16:35.325529 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:35.325531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:35.325545 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:35.325619 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:35.326333 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.326810 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.327838 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.328053 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.328135 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:35.330658 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:35.330660 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:35.330661 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:35.330669 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:35.332247 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:35.333117 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:35.333118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:35.333119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:35.333187 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:35.333476 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:35.333477 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:35.333477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:35.333617 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:35.333675 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:35.334062 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 01:16:35.334170 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 01:16:35.334774 10031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:35.323414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36981 (local address 127.17.183.130:34553)
0812 01:16:35.324639 (+ 1225us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:35.324689 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:35.325361 (+ 672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:35.325692 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:35.325697 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:35.325943 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:35.326221 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:35.326229 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.326954 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.326955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:35.327736 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:35.327739 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.328169 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.328171 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:35.328315 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:35.328847 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:35.328855 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:35.330547 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:35.332357 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:35.332366 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:35.332368 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:35.332999 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:35.333263 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:35.333264 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:35.333264 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:35.333402 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:35.333712 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:35.333719 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:35.333879 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 01:16:35.333986 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 01:16:35.334160 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1179,"thread_start_us":82,"threads_started":1}
I20260812 01:16:35.335287 10023 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36981
I20260812 01:16:35.335394 10023 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:35.335599 10023 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
W20260812 01:16:35.336436 10023 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:36981 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 01:16:35.336547 10023 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:35.336632 10023 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
I20260812 01:16:35.337091 10023 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:35.337177 10023 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
W20260812 01:16:35.337486 10023 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 01:16:35.423645 10033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:35.423861 10033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:35.423900 10033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:35.425207 10033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:35.425271 10033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:35.425316 10033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:16:35.427040 10033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.183.148:53863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:36455
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=38923
--tserver_master_addrs=127.17.183.190:36981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:35.427281 10033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:35.427493 10033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:35.434573 10043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:35.434845 10033 server_base.cc:1034] running on GCE node
W20260812 01:16:35.435034 10040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:35.435281 10041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:35.435514 10033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:35.435781 10033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:35.436971 10033 hybrid_clock.cc:648] HybridClock initialized: now 1786497395436945 us; error 38 us; skew 500 ppm
Aug 12 01:16:35 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:35.440351 10033 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:16:35.440881 10033 webserver.cc:460] Webserver started at http://127.17.183.131:38923/ using document root <none> and password file <none>
I20260812 01:16:35.441134 10033 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:35.441211 10033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 01:16:35 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:16:35.464298 10033 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260812 01:16:35.465497 10060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:35.465682 10033 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 01:16:35.465766 10033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "4314e01ff61246f8921d7c56236cc5e8"
format_stamp: "Formatted at 2026-08-12 01:16:34 on dist-test-slave-rwrg"
server_key: "ebf22363348fa7dcde98014c225aba8e"
server_key_iv: "30d1b8656f785d63c3ad62904231a241"
server_key_version: "kuduclusterkey@0"
I20260812 01:16:35.466192 10033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:35.485726 10033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:35.488471 10033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:35.488669 10033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:35.488935 10033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:35.489351 10033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:35.489408 10033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:35.489447 10033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:35.489473 10033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:35.497308 10033 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:36455
I20260812 01:16:35.497473 10278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:36455 every 8 connection(s)
I20260812 01:16:35.497864 10033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:16:35.500285 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 10033
Aug 12 01:16:35 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:35.510844 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:35.499061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:39669 (local address 127.17.183.190:36981)
0812 01:16:35.499113 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:35.499116 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:35.499127 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:16:35.499637 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:35.499639 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:35.499652 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:35.499705 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:35.500363 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.501078 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.502937 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.503265 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.503317 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:35.506422 (+ 3105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:35.506423 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:35.506424 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:35.506432 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:35.508171 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:35.509647 (+ 1476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:35.509649 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:35.509649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:35.509719 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:35.510038 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:35.510039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:35.510040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:35.510190 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:35.510241 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:35.510656 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 01:16:35.510743 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 01:16:35.511473 10282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:35.498699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36981 (local address 127.17.183.131:39669)
0812 01:16:35.498876 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:35.498921 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:35.499529 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:35.499785 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:35.499789 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:35.499971 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:35.500239 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:35.500245 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.501526 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.501527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:35.502830 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:35.502833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.503443 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.503444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:35.503584 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:35.504161 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:35.504170 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:35.506301 (+ 2131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:35.509169 (+ 2868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:35.509178 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:35.509180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:35.509539 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:35.509799 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:35.509800 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:35.509800 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:35.509950 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:35.510297 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:35.510304 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:35.510484 (+ 180us) client_negotiation.cc:769] Sending connection context
0812 01:16:35.510976 (+ 492us) client_negotiation.cc:240] Negotiation successful
0812 01:16:35.511177 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
I20260812 01:16:35.511950 10279 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36981
I20260812 01:16:35.512075 10279 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:35.512291 10279 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
W20260812 01:16:35.513036 10279 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:36981 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 01:16:35.513135 10279 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:35.513233 10279 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
I20260812 01:16:35.513592 10279 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:35.513677 10279 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
W20260812 01:16:35.514036 10279 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 01:16:35.519078 10284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:35.501349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49342 (local address 127.17.183.190:36981)
0812 01:16:35.504893 (+ 3544us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:35.504895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:35.504904 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:16:35.504926 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:35.504927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:35.504940 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:35.505021 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:35.506746 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.508002 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.514174 (+ 6172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:35.514501 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:35.514577 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:35.516207 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:35.516209 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:35.516209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:35.516217 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:35.517823 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:35.518222 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:35.518224 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:35.518224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:35.518286 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:35.518510 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:35.518511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:35.518511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:35.518634 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:35.518819 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:35.518868 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 01:16:35.518953 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2705,"thread_start_us":68,"threads_started":1}
Aug 12 01:16:36 dist-test-slave-rwrg krb5kdc[7484](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786497396, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:36.121335 9770 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:36.121501 9770 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
I20260812 01:16:36.121969 9414 ts_manager.cc:194] Registered new tserver with Master: 376f50796e364da89a92662a357431b6 (127.17.183.129:38165)
I20260812 01:16:36.123011 9414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:40251
I20260812 01:16:36.337682 10023 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:36.337845 10023 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
I20260812 01:16:36.338196 9414 ts_manager.cc:194] Registered new tserver with Master: bb5efba41e0a438e92daec772b8fb9c3 (127.17.183.130:46261)
I20260812 01:16:36.338626 9414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:34553
Aug 12 01:16:36 dist-test-slave-rwrg krb5kdc[7484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497396, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for HTTP/127.17.183.148@KRBTEST.COM
I20260812 01:16:36.514217 10279 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:36.514358 10279 heartbeater.cc:511] Master 127.17.183.190:36981 requested a full tablet report, sending...
I20260812 01:16:36.514647 9414 ts_manager.cc:194] Registered new tserver with Master: 4314e01ff61246f8921d7c56236cc5e8 (127.17.183.131:36455)
I20260812 01:16:36.515185 9414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:39669
I20260812 01:16:36.516835 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:16:36.532094 10316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.522864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49348 (local address 127.17.183.190:36981)
0812 01:16:36.523703 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:36.523705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:36.523711 (+ 6us) server_negotiation.cc:407] Connection header received
0812 01:16:36.523734 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:36.523734 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:36.523745 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:36.523809 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:36.524617 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.525434 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.526409 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.526773 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.528378 (+ 1605us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.528448 (+ 70us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:36.528449 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:36.528449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:36.528454 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:36.530490 (+ 2036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:36.530945 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:36.530946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:36.530946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:36.531006 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:36.531204 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:36.531205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:36.531205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:36.531349 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:36.531859 (+ 510us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:36.531901 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 01:16:36.531981 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":816,"thread_start_us":59,"threads_started":1}
I20260812 01:16:36.535054 9414 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:16:36.537355 9414 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:16:36.550480 10322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.540697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:36455 (local address 127.0.0.1:43430)
0812 01:16:36.541169 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:36.541180 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:36.541353 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:36.546447 (+ 5094us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:36.546448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:36.546450 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:36.546491 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:36.546492 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.547755 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.547757 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:36.549141 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:36.549144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.550200 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.550201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:36.550253 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.550272 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 01:16:36.550342 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 01:16:36.550386 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":7,"thread_start_us":102,"threads_started":1}
I20260812 01:16:36.550671 10328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.541072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56138 (local address 127.17.183.129:38165)
0812 01:16:36.546755 (+ 5683us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:36.546760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:36.546769 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:16:36.546802 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:36.546804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:36.546820 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:36.547019 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:36.547114 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.548117 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.549355 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.550037 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.550441 (+ 404us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.550509 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:36.550537 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 01:16:36.550581 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5646,"thread_start_us":70,"threads_started":1}
I20260812 01:16:36.551079 10327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.540947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:38165 (local address 127.0.0.1:56138)
0812 01:16:36.546583 (+ 5636us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:36.546595 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:36.546640 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:36.546916 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:36.546917 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:36.546919 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:36.546954 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:36.546956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.548212 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.548213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:36.549261 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:36.549263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.550167 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.550168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:36.550254 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.550272 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 01:16:36.550324 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 01:16:36.550386 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5617,"mutex_wait_us":5,"thread_start_us":73,"threads_started":1}
I20260812 01:16:36.551465 10326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.540789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43430 (local address 127.17.183.131:36455)
0812 01:16:36.542051 (+ 1262us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:36.542055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:36.542064 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:16:36.546345 (+ 4281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:36.546348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:36.546367 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:36.546450 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:36.546586 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.547657 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.549229 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.550015 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.550099 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.550169 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:36.551320 (+ 1151us) server_negotiation.cc:299] Negotiation successful
0812 01:16:36.551384 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1227,"thread_start_us":60,"threads_started":1}
I20260812 01:16:36.552090 9646 tablet_service.cc:1467] Processing CreateTablet for tablet 887763d5015b45cc95f61d68e8c793e3 (DEFAULT_TABLE table=test-table [id=e3c48596317347cfb43a34cf9ce7be3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:16:36.553046 10321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.540696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:46261 (local address 127.0.0.1:45602)
0812 01:16:36.540943 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:36.540984 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:36.541053 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:36.541811 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:36.541814 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:36.541817 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:36.541886 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:36.541888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.544620 (+ 2732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.544621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:36.546193 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:36.546197 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.552844 (+ 6647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.552845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:36.552906 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.552910 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:16:36.552941 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 01:16:36.552978 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":96,"threads_started":1}
I20260812 01:16:36.553120 10144 tablet_service.cc:1467] Processing CreateTablet for tablet 887763d5015b45cc95f61d68e8c793e3 (DEFAULT_TABLE table=test-table [id=e3c48596317347cfb43a34cf9ce7be3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:16:36.553437 10324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.540790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45602 (local address 127.17.183.130:46261)
0812 01:16:36.541468 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:36.541474 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:36.541483 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:16:36.541610 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:36.541612 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:36.541629 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:36.541706 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:36.541964 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.543088 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.546302 (+ 3214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.552742 (+ 6440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.553213 (+ 471us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.553278 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:36.553305 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 01:16:36.553347 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":55,"threads_started":1}
I20260812 01:16:36.553467 10144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887763d5015b45cc95f61d68e8c793e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:36.554030 9898 tablet_service.cc:1467] Processing CreateTablet for tablet 887763d5015b45cc95f61d68e8c793e3 (DEFAULT_TABLE table=test-table [id=e3c48596317347cfb43a34cf9ce7be3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:16:36.554332 9898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887763d5015b45cc95f61d68e8c793e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:36.557747 9646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887763d5015b45cc95f61d68e8c793e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:36.558439 10331 tablet_bootstrap.cc:492] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: Bootstrap starting.
I20260812 01:16:36.559103 10331 tablet_bootstrap.cc:654] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:36.559413 10331 log.cc:824] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:36.560222 10331 tablet_bootstrap.cc:492] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: No bootstrap required, opened a new log
I20260812 01:16:36.560284 10331 ts_tablet_manager.cc:1397] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:16:36.561905 10330 tablet_bootstrap.cc:492] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8: Bootstrap starting.
I20260812 01:16:36.562132 10333 tablet_bootstrap.cc:492] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6: Bootstrap starting.
I20260812 01:16:36.562631 10331 raft_consensus.cc:348] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb5efba41e0a438e92daec772b8fb9c3" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 46261 } } peers { permanent_uuid: "4314e01ff61246f8921d7c56236cc5e8" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36455 } } peers { permanent_uuid: "376f50796e364da89a92662a357431b6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38165 } }
I20260812 01:16:36.562808 10331 raft_consensus.cc:374] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:36.562852 10331 raft_consensus.cc:729] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb5efba41e0a438e92daec772b8fb9c3, State: Initialized, Role: FOLLOWER
I20260812 01:16:36.563006 10331 consensus_queue.cc:260] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb5efba41e0a438e92daec772b8fb9c3" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 46261 } } peers { permanent_uuid: "4314e01ff61246f8921d7c56236cc5e8" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36455 } } peers { permanent_uuid: "376f50796e364da89a92662a357431b6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38165 } }
I20260812 01:16:36.563553 10330 tablet_bootstrap.cc:654] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:36.563647 10333 tablet_bootstrap.cc:654] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:36.563746 10331 ts_tablet_manager.cc:1428] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:16:36.563908 10023 heartbeater.cc:503] Master 127.17.183.190:36981 was elected leader, sending a full tablet report...
I20260812 01:16:36.564004 10333 log.cc:824] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:36.564543 10330 log.cc:824] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:36.565330 10333 tablet_bootstrap.cc:492] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6: No bootstrap required, opened a new log
I20260812 01:16:36.565438 10333 ts_tablet_manager.cc:1397] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 01:16:36.567246 10333 raft_consensus.cc:348] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb5efba41e0a438e92daec772b8fb9c3" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 46261 } } peers { permanent_uuid: "4314e01ff61246f8921d7c56236cc5e8" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36455 } } peers { permanent_uuid: "376f50796e364da89a92662a357431b6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38165 } }
I20260812 01:16:36.567402 10333 raft_consensus.cc:374] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:36.567481 10333 raft_consensus.cc:729] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f50796e364da89a92662a357431b6, State: Initialized, Role: FOLLOWER
I20260812 01:16:36.567634 10333 consensus_queue.cc:260] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb5efba41e0a438e92daec772b8fb9c3" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 46261 } } peers { permanent_uuid: "4314e01ff61246f8921d7c56236cc5e8" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36455 } } peers { permanent_uuid: "376f50796e364da89a92662a357431b6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38165 } }
I20260812 01:16:36.567927 10333 ts_tablet_manager.cc:1428] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 01:16:36.567938 9770 heartbeater.cc:503] Master 127.17.183.190:36981 was elected leader, sending a full tablet report...
I20260812 01:16:36.568671 10330 tablet_bootstrap.cc:492] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8: No bootstrap required, opened a new log
I20260812 01:16:36.568807 10330 ts_tablet_manager.cc:1397] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260812 01:16:36.570963 10330 raft_consensus.cc:348] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb5efba41e0a438e92daec772b8fb9c3" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 46261 } } peers { permanent_uuid: "4314e01ff61246f8921d7c56236cc5e8" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36455 } } peers { permanent_uuid: "376f50796e364da89a92662a357431b6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38165 } }
I20260812 01:16:36.571125 10330 raft_consensus.cc:374] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:36.571203 10330 raft_consensus.cc:729] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4314e01ff61246f8921d7c56236cc5e8, State: Initialized, Role: FOLLOWER
I20260812 01:16:36.571363 10330 consensus_queue.cc:260] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb5efba41e0a438e92daec772b8fb9c3" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 46261 } } peers { permanent_uuid: "4314e01ff61246f8921d7c56236cc5e8" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36455 } } peers { permanent_uuid: "376f50796e364da89a92662a357431b6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38165 } }
I20260812 01:16:36.571646 10330 ts_tablet_manager.cc:1428] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:16:36.571656 10279 heartbeater.cc:503] Master 127.17.183.190:36981 was elected leader, sending a full tablet report...
W20260812 01:16:36.574581 10024 tablet.cc:2369] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:16:36.605283 9772 tablet.cc:2369] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:16:36.637702 10341 raft_consensus.cc:482] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:16:36.637873 10341 raft_consensus.cc:504] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb5efba41e0a438e92daec772b8fb9c3" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 46261 } } peers { permanent_uuid: "4314e01ff61246f8921d7c56236cc5e8" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36455 } } peers { permanent_uuid: "376f50796e364da89a92662a357431b6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38165 } }
I20260812 01:16:36.638307 10341 leader_election.cc:288] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb5efba41e0a438e92daec772b8fb9c3 (127.17.183.130:46261), 376f50796e364da89a92662a357431b6 (127.17.183.129:38165)
I20260812 01:16:36.642653 10328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.638957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:37351 (local address 127.17.183.129:38165)
0812 01:16:36.639003 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:36.639005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:36.639110 (+ 105us) server_negotiation.cc:407] Connection header received
0812 01:16:36.639208 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:36.639209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:36.639220 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:36.639266 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:36.639473 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.640144 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.641584 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.642195 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.642254 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.642261 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:36.642524 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 01:16:36.642580 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 01:16:36.642653 10324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.638592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:36527 (local address 127.17.183.130:46261)
0812 01:16:36.638653 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:36.638655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:36.638840 (+ 185us) server_negotiation.cc:407] Connection header received
0812 01:16:36.638958 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:36.638959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:36.638970 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:36.639002 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:36.639269 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.640037 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.641583 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.642195 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.642248 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.642258 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:36.642523 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 01:16:36.642580 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 01:16:36.642951 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.638507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:46261 (local address 127.17.183.131:36527)
0812 01:16:36.638768 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:36.638781 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:36.638872 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:36.639086 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:36.639087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:36.639089 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:36.639179 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:36.639181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.640137 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.640139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:36.641468 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:36.641472 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.642358 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.642359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:36.642434 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.642438 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:16:36.642795 (+ 357us) client_negotiation.cc:240] Negotiation successful
0812 01:16:36.642851 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":4,"thread_start_us":131,"threads_started":1}
I20260812 01:16:36.643213 10343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.638752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:38165 (local address 127.17.183.131:37351)
0812 01:16:36.639056 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:36.639065 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:36.639133 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:36.639331 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:36.639332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:36.639334 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:36.639394 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:36.639395 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.640233 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.640234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:36.641468 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:36.641472 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.642359 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.642360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:36.642434 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.642437 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:16:36.643085 (+ 648us) client_negotiation.cc:240] Negotiation successful
0812 01:16:36.643135 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":48,"thread_start_us":73,"threads_started":1}
I20260812 01:16:36.643388 9923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887763d5015b45cc95f61d68e8c793e3" candidate_uuid: "4314e01ff61246f8921d7c56236cc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb5efba41e0a438e92daec772b8fb9c3" is_pre_election: true
I20260812 01:16:36.643610 9923 raft_consensus.cc:2454] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4314e01ff61246f8921d7c56236cc5e8 in term 0.
I20260812 01:16:36.643581 9675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887763d5015b45cc95f61d68e8c793e3" candidate_uuid: "4314e01ff61246f8921d7c56236cc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f50796e364da89a92662a357431b6" is_pre_election: true
I20260812 01:16:36.643740 9675 raft_consensus.cc:2454] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4314e01ff61246f8921d7c56236cc5e8 in term 0.
I20260812 01:16:36.643946 10063 leader_election.cc:302] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4314e01ff61246f8921d7c56236cc5e8, bb5efba41e0a438e92daec772b8fb9c3; no voters:
I20260812 01:16:36.644102 10341 raft_consensus.cc:2781] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:16:36.644191 10341 raft_consensus.cc:482] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:16:36.644223 10341 raft_consensus.cc:3037] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:36.645291 10341 raft_consensus.cc:504] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb5efba41e0a438e92daec772b8fb9c3" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 46261 } } peers { permanent_uuid: "4314e01ff61246f8921d7c56236cc5e8" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36455 } } peers { permanent_uuid: "376f50796e364da89a92662a357431b6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38165 } }
I20260812 01:16:36.645591 10341 leader_election.cc:288] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [CANDIDATE]: Term 1 election: Requested vote from peers bb5efba41e0a438e92daec772b8fb9c3 (127.17.183.130:46261), 376f50796e364da89a92662a357431b6 (127.17.183.129:38165)
I20260812 01:16:36.645834 9923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887763d5015b45cc95f61d68e8c793e3" candidate_uuid: "4314e01ff61246f8921d7c56236cc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb5efba41e0a438e92daec772b8fb9c3"
I20260812 01:16:36.645876 9675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887763d5015b45cc95f61d68e8c793e3" candidate_uuid: "4314e01ff61246f8921d7c56236cc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f50796e364da89a92662a357431b6"
I20260812 01:16:36.645922 9923 raft_consensus.cc:3037] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:36.645956 9675 raft_consensus.cc:3037] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:36.646848 9675 raft_consensus.cc:2454] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4314e01ff61246f8921d7c56236cc5e8 in term 1.
I20260812 01:16:36.646863 9923 raft_consensus.cc:2454] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4314e01ff61246f8921d7c56236cc5e8 in term 1.
I20260812 01:16:36.647058 10063 leader_election.cc:302] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4314e01ff61246f8921d7c56236cc5e8, bb5efba41e0a438e92daec772b8fb9c3; no voters:
I20260812 01:16:36.647161 10341 raft_consensus.cc:2781] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:16:36.647339 10341 raft_consensus.cc:686] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [term 1 LEADER]: Becoming Leader. State: Replica: 4314e01ff61246f8921d7c56236cc5e8, State: Running, Role: LEADER
I20260812 01:16:36.647504 10341 consensus_queue.cc:237] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb5efba41e0a438e92daec772b8fb9c3" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 46261 } } peers { permanent_uuid: "4314e01ff61246f8921d7c56236cc5e8" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36455 } } peers { permanent_uuid: "376f50796e364da89a92662a357431b6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38165 } }
I20260812 01:16:36.648425 9414 catalog_manager.cc:5495] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4314e01ff61246f8921d7c56236cc5e8 (127.17.183.131). New cstate: current_term: 1 leader_uuid: "4314e01ff61246f8921d7c56236cc5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb5efba41e0a438e92daec772b8fb9c3" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 46261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4314e01ff61246f8921d7c56236cc5e8" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f50796e364da89a92662a357431b6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38165 } health_report { overall_health: UNKNOWN } } }
I20260812 01:16:36.662421 10326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.659247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43440 (local address 127.17.183.131:36455)
0812 01:16:36.659292 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:36.659294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:36.659304 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:16:36.659350 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:36.659351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:36.659373 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:36.659456 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:16:36.659607 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.660346 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.661488 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:36.661789 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:36.661884 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:36.662060 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:16:36.662189 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:16:36.662287 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:36.662318 (+ 31us) server_negotiation.cc:299] Negotiation successful
0812 01:16:36.662340 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:16:36.664660 9675 raft_consensus.cc:1261] T 887763d5015b45cc95f61d68e8c793e3 P 376f50796e364da89a92662a357431b6 [term 1 FOLLOWER]: Refusing update from remote peer 4314e01ff61246f8921d7c56236cc5e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:16:36.664669 9923 raft_consensus.cc:1261] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3 [term 1 FOLLOWER]: Refusing update from remote peer 4314e01ff61246f8921d7c56236cc5e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:16:36.664989 10341 consensus_queue.cc:1035] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb5efba41e0a438e92daec772b8fb9c3" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 46261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:16:36.665203 10345 consensus_queue.cc:1035] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f50796e364da89a92662a357431b6" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:16:36.670640 10352 mvcc.cc:205] Tried to move back new op lower bound from 7317493336735219712 to 7317493336669044736. Current Snapshot: MvccSnapshot[applied={T|T < 7317493336735219712}]
I20260812 01:16:36.674816 9413 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:16:36.674923 9413 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:16:36.675863 9413 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e2d66899dc554041876631f23d709e60: Sending DeleteTablet for 3 replicas of tablet 887763d5015b45cc95f61d68e8c793e3
I20260812 01:16:36.676252 9898 tablet_service.cc:1514] Processing DeleteTablet for tablet 887763d5015b45cc95f61d68e8c793e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:16:36 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:45602
I20260812 01:16:36.676577 9646 tablet_service.cc:1514] Processing DeleteTablet for tablet 887763d5015b45cc95f61d68e8c793e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:16:36 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:56138
I20260812 01:16:36.677014 10144 tablet_service.cc:1514] Processing DeleteTablet for tablet 887763d5015b45cc95f61d68e8c793e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:16:36 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:43430
I20260812 01:16:36.677659 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 9481
I20260812 01:16:36.680634 10377 tablet_replica.cc:330] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: stopping tablet replica
I20260812 01:16:36.680751 10377 raft_consensus.cc:2229] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:16:36.680856 10377 raft_consensus.cc:2258] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:16:36.696679 10377 ts_tablet_manager.cc:1905] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:16:36.698575 10377 ts_tablet_manager.cc:1918] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:16:36.698666 10377 log.cc:1196] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/887763d5015b45cc95f61d68e8c793e3
I20260812 01:16:36.698956 10377 ts_tablet_manager.cc:1939] T 887763d5015b45cc95f61d68e8c793e3 P bb5efba41e0a438e92daec772b8fb9c3: Deleting consensus metadata
I20260812 01:16:36.699433 9388 catalog_manager.cc:4841] TS bb5efba41e0a438e92daec772b8fb9c3 (127.17.183.130:46261): tablet 887763d5015b45cc95f61d68e8c793e3 (table test-table [id=e3c48596317347cfb43a34cf9ce7be3f]) successfully deleted
W20260812 01:16:36.705518 9388 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:38165 (error 108)
I20260812 01:16:36.706291 10380 tablet_replica.cc:330] T 887763d5015b45cc95f61d68e8c793e3 P 4314e01ff61246f8921d7c56236cc5e8: stopping tablet replica
I20260812 01:16:36.706516 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 9773
I20260812 01:16:36.717060 10327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:36.716878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:38165 (local address 127.0.0.1:56140)
0812 01:16:36.716952 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:36.717007 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:38165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 01:16:36.717440 9388 catalog_manager.cc:4584] TS 376f50796e364da89a92662a357431b6 (127.17.183.129:38165): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 887763d5015b45cc95f61d68e8c793e3: Network error: Client connection negotiation failed: client connection to 127.17.183.129:38165: connect: Connection refused (error 111)
I20260812 01:16:36.719185 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 10033
W20260812 01:16:36.729076 10327 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:16:36.728662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:36455 (local address 127.0.0.1:43448)
0812 01:16:36.728718 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:36.728730 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:36.728778 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:36.729003 (+ 225us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.131:36455: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 01:16:36.729689 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 9355
I20260812 01:16:36.746054 18142 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 01:16:37.090903 18142 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 01:16:37.090992 18142 mini_ranger.cc:66] Stopping Ranger...
I20260812 01:16:37.446583 18142 mini_ranger.cc:68] Stopped Ranger
2026-08-12 01:16:37.446 UTC [7542] LOG: received smart shutdown request
2026-08-12 01:16:37.451 UTC [7542] LOG: background worker "logical replication launcher" (PID 7558) exited with exit code 1
2026-08-12 01:16:37.451 UTC [7547] LOG: shutting down
2026-08-12 01:16:37.610 UTC [7542] LOG: database system is shut down
2026-08-12T01:16:37Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49793 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:16:37 dist-test-slave-rwrg krb5kdc[10402](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:16:37 dist-test-slave-rwrg krb5kdc[10402](info): set up 2 sockets
Aug 12 01:16:37 dist-test-slave-rwrg krb5kdc[10402](info): commencing operation
krb5kdc: starting...
W20260812 01:16:39.000339 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:16:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:16:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:16:39.121622 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33457
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:35139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:33457,127.17.183.189:39191,127.17.183.188:38521
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:39.203733 10428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:39.203951 10428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:39.203989 10428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:39.205142 10428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:16:39.205204 10428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:39.205229 10428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:39.205260 10428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:16:39.205283 10428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:16:39.206787 10428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:33457,127.17.183.189:39191,127.17.183.188:38521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:39.207046 10428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:39.207290 10428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:39.212122 10437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:39.212172 10439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:39.212234 10428 server_base.cc:1034] running on GCE node
W20260812 01:16:39.212167 10441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:39.212631 10428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:39.212922 10428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:39.214089 10428 hybrid_clock.cc:648] HybridClock initialized: now 1786497399214078 us; error 29 us; skew 500 ppm
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:39.221861 10428 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:16:39.222298 10428 webserver.cc:460] Webserver started at http://127.17.183.190:44379/ using document root <none> and password file <none>
I20260812 01:16:39.222548 10428 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:39.222615 10428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:39.222761 10428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:16:39.223838 10428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "2026a00a29f7482f89d76450036f87b1"
format_stamp: "Formatted at 2026-08-12 01:16:39 on dist-test-slave-rwrg"
server_key: "2f236ef101cfafad6f18c32d1fc04a0b"
server_key_iv: "07a86f457ffa34f4ad9be59b872dc8f9"
server_key_version: "encryptionkey@0"
I20260812 01:16:39.224191 10428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "2026a00a29f7482f89d76450036f87b1"
format_stamp: "Formatted at 2026-08-12 01:16:39 on dist-test-slave-rwrg"
server_key: "2f236ef101cfafad6f18c32d1fc04a0b"
server_key_iv: "07a86f457ffa34f4ad9be59b872dc8f9"
server_key_version: "encryptionkey@0"
I20260812 01:16:39.225498 10428 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 01:16:39.226259 10451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:39.226430 10428 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:16:39.226529 10428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "2026a00a29f7482f89d76450036f87b1"
format_stamp: "Formatted at 2026-08-12 01:16:39 on dist-test-slave-rwrg"
server_key: "2f236ef101cfafad6f18c32d1fc04a0b"
server_key_iv: "07a86f457ffa34f4ad9be59b872dc8f9"
server_key_version: "encryptionkey@0"
I20260812 01:16:39.226606 10428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:39.239178 10428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:39.241530 10428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:39.241690 10428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:39.245898 10428 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:33457
I20260812 01:16:39.245966 10556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:33457 every 8 connection(s)
I20260812 01:16:39.246340 10428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:16:39.246742 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 10428
I20260812 01:16:39.246882 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:16:39.247128 18142 external_mini_cluster.cc:1428] Setting key 050944db2be585874532e90735ea6021
I20260812 01:16:39.247437 10557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:39.249730 10557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.183.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.189@KRBTEST.COM" created.
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:39.262323 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.250427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33457 (local address 127.0.0.1:34072)
0812 01:16:39.250609 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.250653 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:39.251150 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:39.251453 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:39.251456 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:39.251790 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:39.251936 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.251941 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.253087 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.253088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.253732 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.253734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.254238 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.254239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.254303 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.254837 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:39.254845 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:39.258992 (+ 4147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:39.260842 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.260849 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.260851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.261086 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.261369 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.261370 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.261370 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.261446 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.261877 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:39.261881 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:39.261935 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 01:16:39.262004 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 01:16:39.262131 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":98,"threads_started":1}
I20260812 01:16:39.262367 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.250451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34072 (local address 127.17.183.190:33457)
0812 01:16:39.250673 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.250678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.250739 (+ 61us) server_negotiation.cc:407] Connection header received
0812 01:16:39.251309 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.251311 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.251330 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.251433 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.252038 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.252981 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.253832 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.254145 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.254261 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.259091 (+ 4830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.259100 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.259100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.259106 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.260759 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.261173 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.261176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.261176 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.261296 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.261510 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.261511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.261512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.261803 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.261904 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.262065 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.262223 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":199,"thread_start_us":92,"threads_started":1}
I20260812 01:16:39.263149 10557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:16:39.263484 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.263372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39191 (local address 127.0.0.1:47978)
0812 01:16:39.263418 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.263459 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 01:16:39.263607 10471 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39191: connect: Connection refused (error 111)
I20260812 01:16:39.263976 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.263891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39191 (local address 127.0.0.1:47992)
0812 01:16:39.263933 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.263956 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 01:16:39.264081 10557 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.189:39191: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39191: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab.
Entry for principal kudu/127.17.183.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab.
I20260812 01:16:39.274677 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.189:39191
--webserver_interface=127.17.183.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab
--principal=kudu/127.17.183.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:35139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:33457,127.17.183.189:39191,127.17.183.188:38521
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:16:39.313333 10557 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } attempt: 1
I20260812 01:16:39.313892 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.313728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39191 (local address 127.0.0.1:48006)
0812 01:16:39.313806 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.313854 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 01:16:39.314280 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.314185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39191 (local address 127.0.0.1:48020)
0812 01:16:39.314229 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.314258 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 01:16:39.314376 10557 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.189:39191: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39191: connect: Connection refused (error 111)
W20260812 01:16:39.357817 10573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:39.358014 10573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:39.358035 10573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:39.359084 10573 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:16:39.359151 10573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:39.359176 10573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:39.359200 10573 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:16:39.359231 10573 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:16:39.360729 10573 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:33457,127.17.183.189:39191,127.17.183.188:38521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab
--principal=kudu/127.17.183.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.189:39191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.183.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:39.360915 10573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:39.361089 10573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:39.365747 10579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:39.365713 10582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:39.365723 10585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:39.365989 10573 server_base.cc:1034] running on GCE node
I20260812 01:16:39.366361 10573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:39.366611 10573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:39.367789 10573 hybrid_clock.cc:648] HybridClock initialized: now 1786497399367777 us; error 35 us; skew 500 ppm
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:39.370398 10573 init.cc:377] Logged in from keytab as kudu/127.17.183.189@KRBTEST.COM (short username kudu)
I20260812 01:16:39.370802 10573 webserver.cc:460] Webserver started at http://127.17.183.189:45669/ using document root <none> and password file <none>
I20260812 01:16:39.370983 10573 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:39.371022 10573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:39.371111 10573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:16:39.372107 10573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/data/instance:
uuid: "63453dd7961b44ee8e3e2cc6b9132a8e"
format_stamp: "Formatted at 2026-08-12 01:16:39 on dist-test-slave-rwrg"
server_key: "3874db8f4b9c9cb09d3b9411b6258cfd"
server_key_iv: "40369d5834a6159d396020fc56ffe9aa"
server_key_version: "encryptionkey@0"
I20260812 01:16:39.372426 10573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/wal/instance:
uuid: "63453dd7961b44ee8e3e2cc6b9132a8e"
format_stamp: "Formatted at 2026-08-12 01:16:39 on dist-test-slave-rwrg"
server_key: "3874db8f4b9c9cb09d3b9411b6258cfd"
server_key_iv: "40369d5834a6159d396020fc56ffe9aa"
server_key_version: "encryptionkey@0"
I20260812 01:16:39.373720 10573 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:16:39.374387 10596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:39.374538 10573 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:16:39.374634 10573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/wal
uuid: "63453dd7961b44ee8e3e2cc6b9132a8e"
format_stamp: "Formatted at 2026-08-12 01:16:39 on dist-test-slave-rwrg"
server_key: "3874db8f4b9c9cb09d3b9411b6258cfd"
server_key_iv: "40369d5834a6159d396020fc56ffe9aa"
server_key_version: "encryptionkey@0"
I20260812 01:16:39.374687 10573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:39.382503 10557 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } attempt: 2
I20260812 01:16:39.382905 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.382777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39191 (local address 127.0.0.1:48036)
0812 01:16:39.382839 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.382877 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 01:16:39.383296 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.383204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39191 (local address 127.0.0.1:48046)
0812 01:16:39.383252 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.383277 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 01:16:39.383404 10557 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.189:39191: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39191: connect: Connection refused (error 111)
I20260812 01:16:39.388243 10573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:39.390148 10573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:39.390259 10573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:39.394213 10573 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.189:39191
I20260812 01:16:39.394261 10690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.189:39191 every 8 connection(s)
I20260812 01:16:39.394610 10573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
I20260812 01:16:39.395464 10693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:39.397208 10693 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:16:39.399832 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 10573
I20260812 01:16:39.399967 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-1/wal/instance
I20260812 01:16:39.400166 18142 external_mini_cluster.cc:1428] Setting key 125ef1a561b6b69ab711be3b9c0fa6d7
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:39.406922 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.397924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34086 (local address 127.17.183.190:33457)
0812 01:16:39.397975 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.397978 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.398171 (+ 193us) server_negotiation.cc:407] Connection header received
0812 01:16:39.398637 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.398638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.398650 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.398693 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.399279 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.399763 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.401253 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.401450 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.401508 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.403949 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.403951 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.403952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.403959 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.405453 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.405922 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.405923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.405924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.405987 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.406263 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.406264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.406264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.406388 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.406462 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.406742 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.406830 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 01:16:39.407148 10695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.397865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33457 (local address 127.0.0.1:34086)
0812 01:16:39.398037 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.398088 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:39.398523 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:39.398774 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:39.398777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:39.399012 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:39.399210 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.399214 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.399874 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.399875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.401156 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.401159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.401535 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.401537 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.401679 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.402244 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:39.402253 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:39.403845 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:39.405559 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.405567 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.405569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.405812 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.406071 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.406072 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.406072 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.406189 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.406466 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:39.406474 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:39.406611 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 01:16:39.406720 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 01:16:39.406890 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
I20260812 01:16:39.407924 10693 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.183.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.188@KRBTEST.COM" created.
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
I20260812 01:16:39.416018 10695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.408202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39191 (local address 127.0.0.1:48052)
0812 01:16:39.408262 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.408275 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:39.408324 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:39.408620 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:39.408622 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:39.408770 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:39.408813 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.408815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.409771 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.409772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.410397 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.410399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.410870 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.410872 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.410936 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.411434 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:39.411439 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:39.412667 (+ 1228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:39.414890 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.414891 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.414891 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.415049 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.415310 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.415311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.415311 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.415371 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.415691 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:39.415692 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:39.415729 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 01:16:39.415803 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 01:16:39.415906 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 01:16:39.416182 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.408258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48052 (local address 127.17.183.189:39191)
0812 01:16:39.408424 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.408430 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.408449 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:16:39.408479 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.408480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.408528 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.408616 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.408890 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.409672 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.410501 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.410796 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.410874 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.412773 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.412781 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.412782 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.412788 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.414797 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.415143 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.415146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.415146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.415228 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.415453 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.415454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.415454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.415615 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.415712 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.415832 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.415958 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":135,"thread_start_us":107,"threads_started":1}
I20260812 01:16:39.416875 10693 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:16:39.417240 10695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.417129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60796)
0812 01:16:39.417172 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.417218 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 01:16:39.417414 10600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
I20260812 01:16:39.417833 10695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.417763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60802)
0812 01:16:39.417789 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.417815 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260812 01:16:39.418004 10693 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:38521: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab.
Entry for principal kudu/127.17.183.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab.
I20260812 01:16:39.428113 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.188:38521
--webserver_interface=127.17.183.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab
--principal=kudu/127.17.183.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:35139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:33457,127.17.183.189:39191,127.17.183.188:38521
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:16:39.467257 10693 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } attempt: 1
I20260812 01:16:39.467821 10695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.467672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60812)
0812 01:16:39.467746 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.467793 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 01:16:39.468237 10695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.468150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60816)
0812 01:16:39.468194 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.468219 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 01:16:39.468375 10693 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:38521: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
I20260812 01:16:39.474561 10557 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } attempt: 3
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
I20260812 01:16:39.481781 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.474880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39191 (local address 127.0.0.1:48062)
0812 01:16:39.474942 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.474954 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:39.475028 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:39.475187 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:39.475188 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:39.475373 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:39.475451 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.475453 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.476175 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.476176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.476747 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.476750 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.477185 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.477186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.477287 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.477790 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:39.477794 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:39.479089 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:39.480835 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.480836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.480836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.480998 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.481212 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.481212 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.481213 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.481266 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.481527 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:39.481528 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:39.481564 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 01:16:39.481614 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 01:16:39.481688 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 01:16:39.481887 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.474969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48062 (local address 127.17.183.189:39191)
0812 01:16:39.475033 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.475035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.475062 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:16:39.475090 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.475091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.475103 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.475168 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.475546 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.476076 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.476830 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.477106 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.477186 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.479173 (+ 1987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.479175 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.479175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.479183 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.480742 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.481068 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.481070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.481070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.481144 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.481327 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.481328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.481328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.481463 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.481532 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.481658 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.481769 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 01:16:39.482234 10557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:16:39.482558 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.482453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60824)
0812 01:16:39.482494 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.482530 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 01:16:39.482939 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.482831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60834)
0812 01:16:39.482892 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.482920 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 01:16:39.483158 10557 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:38521: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
I20260812 01:16:39.514310 10557 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } attempt: 1
I20260812 01:16:39.514814 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.514656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60840)
0812 01:16:39.514732 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.514766 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 01:16:39.515157 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.515059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60856)
0812 01:16:39.515105 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.515133 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 01:16:39.515250 10557 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:38521: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
W20260812 01:16:39.515168 10703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:39.515450 10703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:39.515477 10703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:39.516700 10703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:16:39.516741 10703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:39.516755 10703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:39.516786 10703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:16:39.516814 10703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:16:39.518301 10703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:33457,127.17.183.189:39191,127.17.183.188:38521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab
--principal=kudu/127.17.183.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.188:38521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.183.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:39.518563 10703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:39.518814 10703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:39.523583 10711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:39.523733 10703 server_base.cc:1034] running on GCE node
W20260812 01:16:39.523590 10710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:39.523622 10713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:39.524062 10703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:39.524375 10703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:39.525579 10703 hybrid_clock.cc:648] HybridClock initialized: now 1786497399525524 us; error 32 us; skew 500 ppm
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:39.527983 10703 init.cc:377] Logged in from keytab as kudu/127.17.183.188@KRBTEST.COM (short username kudu)
I20260812 01:16:39.528434 10703 webserver.cc:460] Webserver started at http://127.17.183.188:46155/ using document root <none> and password file <none>
I20260812 01:16:39.528723 10703 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:39.528795 10703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:39.528945 10703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:16:39.530055 10703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/data/instance:
uuid: "e9d164ad1f1a4d269701daae52e854c7"
format_stamp: "Formatted at 2026-08-12 01:16:39 on dist-test-slave-rwrg"
server_key: "717d59eb887adeb8b1d6368c0baffc3d"
server_key_iv: "79cb6c0585edb8d2fc21f70b06060f76"
server_key_version: "encryptionkey@0"
I20260812 01:16:39.530422 10703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/wal/instance:
uuid: "e9d164ad1f1a4d269701daae52e854c7"
format_stamp: "Formatted at 2026-08-12 01:16:39 on dist-test-slave-rwrg"
server_key: "717d59eb887adeb8b1d6368c0baffc3d"
server_key_iv: "79cb6c0585edb8d2fc21f70b06060f76"
server_key_version: "encryptionkey@0"
I20260812 01:16:39.531692 10703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:16:39.532402 10726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:39.532581 10703 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:16:39.532688 10703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/wal
uuid: "e9d164ad1f1a4d269701daae52e854c7"
format_stamp: "Formatted at 2026-08-12 01:16:39 on dist-test-slave-rwrg"
server_key: "717d59eb887adeb8b1d6368c0baffc3d"
server_key_iv: "79cb6c0585edb8d2fc21f70b06060f76"
server_key_version: "encryptionkey@0"
I20260812 01:16:39.532760 10703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:39.536597 10693 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } attempt: 2
I20260812 01:16:39.537048 10695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.536904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60860)
0812 01:16:39.536963 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.537004 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 01:16:39.537597 10695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.537319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60872)
0812 01:16:39.537374 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.537555 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 01:16:39.537768 10693 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:38521: Network error: Client connection negotiation failed: client connection to 127.17.183.188:38521: connect: Connection refused (error 111)
I20260812 01:16:39.568333 10703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:39.570358 10703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:39.570487 10703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:39.574828 10703 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.188:38521
I20260812 01:16:39.574878 10842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.188:38521 every 8 connection(s)
I20260812 01:16:39.575261 10703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
I20260812 01:16:39.576200 10844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:39.577992 10844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:39.583897 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 10703
I20260812 01:16:39.584036 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786497235894345-18142-0/minicluster-data/master-2/wal/instance
I20260812 01:16:39.584276 18142 external_mini_cluster.cc:1428] Setting key 5b5773c1a250f4929bfc1ca62185d617
I20260812 01:16:39.588245 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.578788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34094 (local address 127.17.183.190:33457)
0812 01:16:39.578855 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.578857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.579026 (+ 169us) server_negotiation.cc:407] Connection header received
0812 01:16:39.579475 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.579477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.579485 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.579549 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.580143 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.580680 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.581619 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.581817 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.581871 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.584078 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.584079 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.584080 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.584088 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.585963 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.586532 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.586534 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.586534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.586592 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.587497 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.587499 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.587499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.587650 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.587718 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.588054 (+ 336us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.588141 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 01:16:39.588371 10846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.578730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33457 (local address 127.0.0.1:34094)
0812 01:16:39.578892 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.578935 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:39.579393 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:39.579623 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:39.579626 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:39.579883 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:39.580070 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.580073 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.580762 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.580763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.581541 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.581543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.581894 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.581895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.582002 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.582439 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:39.582447 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:39.583955 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:39.586067 (+ 2112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.586074 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.586076 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.586397 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.587317 (+ 920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.587317 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.587318 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.587423 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.587734 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:39.587747 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:39.587860 (+ 113us) client_negotiation.cc:769] Sending connection context
0812 01:16:39.587998 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 01:16:39.588169 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260812 01:16:39.589097 10844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
I20260812 01:16:39.590404 10557 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } attempt: 2
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
I20260812 01:16:39.594050 10848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.584724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60882 (local address 127.17.183.188:38521)
0812 01:16:39.584875 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.584879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.584931 (+ 52us) server_negotiation.cc:407] Connection header received
0812 01:16:39.585010 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.585013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.585027 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.585135 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.585871 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.586590 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.587303 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.587583 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.587636 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.590426 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.590435 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.590436 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.590444 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.592721 (+ 2277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.593124 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.593127 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.593127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.593187 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.593407 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.593408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.593408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.593583 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.593748 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.593834 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.593921 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
I20260812 01:16:39.596343 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.589551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48070 (local address 127.17.183.189:39191)
0812 01:16:39.589600 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.589602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.589611 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:16:39.589638 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.589639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.589651 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.589715 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.590035 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.590697 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.591372 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.591632 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.591688 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.593615 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.593616 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.593617 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.593625 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.595201 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.595556 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.595558 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.595558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.595621 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.595819 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.595820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.595821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.595961 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.596020 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.596179 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.596250 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 01:16:39.596344 10846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.589454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39191 (local address 127.0.0.1:48070)
0812 01:16:39.589505 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.589515 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:39.589553 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:39.589725 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:39.589725 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:39.589839 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:39.589946 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.589948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.590792 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.590794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.591287 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.591289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.591707 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.591708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.591785 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.592169 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:39.592174 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:39.593514 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:39.595303 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.595304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.595304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.595484 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.595689 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.595690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.595690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.595747 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.596025 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:39.596026 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:39.596065 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 01:16:39.596152 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 01:16:39.596240 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 01:16:39.597108 10844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:16:39.600250 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.590638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60896)
0812 01:16:39.590686 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.590696 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:39.590731 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:39.591515 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:39.591516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:39.591656 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:39.591713 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.591714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.592529 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.592530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.593172 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.593175 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.593564 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.593565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.593622 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.594652 (+ 1030us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:39.594657 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:39.596188 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:39.599123 (+ 2935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.599124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.599126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.599359 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.599602 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.599603 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.599604 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.599665 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.599944 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:39.599945 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:39.599992 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 01:16:39.600043 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 01:16:39.600140 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:39.600750 10849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.590702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60896 (local address 127.17.183.188:38521)
0812 01:16:39.591387 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.591388 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.591393 (+ 5us) server_negotiation.cc:407] Connection header received
0812 01:16:39.591433 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.591433 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.591443 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.591508 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.591804 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.592412 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.593265 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.593490 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.593562 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.596286 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.596287 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.596287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.596293 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.599017 (+ 2724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.599459 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.599459 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.599461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.599521 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.599741 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.599742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.599742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.599864 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.600444 (+ 580us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.600486 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.600585 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":100,"threads_started":1}
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
I20260812 01:16:39.602975 10557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1: Bootstrap starting.
I20260812 01:16:39.603854 10557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:39.604179 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.595018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34100 (local address 127.17.183.190:33457)
0812 01:16:39.595052 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.595054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.595125 (+ 71us) server_negotiation.cc:407] Connection header received
0812 01:16:39.595218 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.595219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.595230 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.595277 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.595941 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.596960 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.598108 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.598425 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.598497 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.601156 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.601157 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.601157 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.601165 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.602824 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.603196 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.603197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.603197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.603260 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.603511 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.603512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.603513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.603632 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.603741 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.604001 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.604074 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 01:16:39.604224 10557 log.cc:824] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:39.605177 10848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.597427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60904 (local address 127.17.183.188:38521)
0812 01:16:39.597521 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.597523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.597527 (+ 4us) server_negotiation.cc:407] Connection header received
0812 01:16:39.597539 (+ 12us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.597539 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.597545 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.597601 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.597857 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.598445 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.599698 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.599937 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.600009 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.602225 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.602226 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.602227 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.602233 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.603762 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.604150 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.604151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.604151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.604199 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.604587 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.604588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.604588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.604762 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.604856 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.605034 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.605126 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 01:16:39.605230 10557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1: No bootstrap required, opened a new log
I20260812 01:16:39.605460 10846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.597372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60904)
0812 01:16:39.597412 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.597422 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:39.597456 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:39.597611 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:39.597612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:39.597754 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:39.597776 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.597777 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.598538 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.598540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.599604 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.599608 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.600008 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.600009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.600059 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.600589 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:39.600593 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:39.602141 (+ 1548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:39.603862 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.603863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.603863 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.604064 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.604403 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.604404 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.604404 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.604475 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.604882 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:39.604883 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:39.604934 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 01:16:39.605301 (+ 367us) client_negotiation.cc:240] Negotiation successful
0812 01:16:39.605381 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 01:16:39.607007 10844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7: Bootstrap starting.
I20260812 01:16:39.607472 10557 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } }
I20260812 01:16:39.607604 10557 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:39.607647 10557 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2026a00a29f7482f89d76450036f87b1, State: Initialized, Role: FOLLOWER
I20260812 01:16:39.607741 10844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:39.607793 10557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } }
I20260812 01:16:39.608053 10844 log.cc:824] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:39.608131 10557 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:16:39.608134 10851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } } }
I20260812 01:16:39.608263 10851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [sys.catalog]: This master's current role is: FOLLOWER
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
I20260812 01:16:39.609203 10844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7: No bootstrap required, opened a new log
W20260812 01:16:39.610114 10879 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:16:39.610173 10879 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:16:39.611400 10844 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } }
I20260812 01:16:39.611552 10844 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:39.611586 10844 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9d164ad1f1a4d269701daae52e854c7, State: Initialized, Role: FOLLOWER
I20260812 01:16:39.611704 10844 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } }
I20260812 01:16:39.611989 10844 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:16:39.612406 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.604828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48082 (local address 127.17.183.189:39191)
0812 01:16:39.604870 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.604872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.604881 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:16:39.604924 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.604925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.604934 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.604984 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.605603 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.606181 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.606834 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.607028 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.607104 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.609684 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.609686 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.609686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.609693 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.611277 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.611637 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.611639 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.611639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.611696 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.611878 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.611879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.611879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.611988 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.612196 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.612235 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.612305 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 01:16:39.614229 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 01:16:39.614770 10897 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:16:39.615983 10897 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:16:39.614941 10882 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } } }
I20260812 01:16:39.616048 10882 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:16:39.614214 10428 master_runner.cc:186] Error getting master registration for 127.17.183.189:39191: OK, instance_id { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" instance_seqno: 1786497399393095 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:16:39.616498 10428 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:16:39.617460 10703 master_runner.cc:186] Error getting master registration for 127.17.183.189:39191: OK, instance_id { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" instance_seqno: 1786497399393095 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:16:39.619746 10703 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:16:39.625556 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.616471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48090 (local address 127.17.183.189:39191)
0812 01:16:39.616508 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.616510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.616972 (+ 462us) server_negotiation.cc:407] Connection header received
0812 01:16:39.617066 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.617067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.617077 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.617106 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.617816 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.618582 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.619625 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.619916 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.619958 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.621567 (+ 1609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.621569 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.621569 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.621577 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.623147 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.623553 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.623554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.623554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.623608 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.624060 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.624061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.624062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.624192 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.624273 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.625391 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.625470 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 01:16:39.627090 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.615766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34104 (local address 127.17.183.190:33457)
0812 01:16:39.615812 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.615814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.616822 (+ 1008us) server_negotiation.cc:407] Connection header received
0812 01:16:39.616982 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.616983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.616993 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.617021 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.620511 (+ 3490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.621213 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.622210 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.622492 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.622533 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.623923 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.623924 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.623925 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.623931 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.625624 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.626214 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.626215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.626215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.626272 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.626478 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.626479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.626479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.626616 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.626715 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.626932 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.627004 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 01:16:39.628932 10693 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } attempt: 3
Aug 12 01:16:39 dist-test-slave-rwrg krb5kdc[10402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497399, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
I20260812 01:16:39.635807 10848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.616797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60906 (local address 127.17.183.188:38521)
0812 01:16:39.616866 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.616867 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.620349 (+ 3482us) server_negotiation.cc:407] Connection header received
0812 01:16:39.620464 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.620464 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.620475 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.620523 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.624477 (+ 3954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.625265 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.627043 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.627370 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.627413 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.632487 (+ 5074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.632506 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.632506 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.632513 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.634441 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.634833 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.634834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.634835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.634889 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.635150 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.635151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.635151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.635285 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.635366 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.635626 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.635709 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 01:16:39.637921 10695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.629211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:38521 (local address 127.0.0.1:60918)
0812 01:16:39.629315 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:39.629325 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:39.629361 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:39.629611 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:39.629612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:39.629766 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:39.629805 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.629807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.630784 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.630785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.631603 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:39.631605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.632131 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.632132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:39.632184 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.632778 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:39.632783 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:39.634571 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:39.636835 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.636836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.636836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.637049 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.637273 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:39.637273 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:39.637274 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:39.637337 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:39.637612 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:39.637613 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:39.637658 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 01:16:39.637729 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 01:16:39.637823 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 01:16:39.637935 10849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:39.629430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60918 (local address 127.17.183.188:38521)
0812 01:16:39.629464 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:39.629466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:39.629472 (+ 6us) server_negotiation.cc:407] Connection header received
0812 01:16:39.629492 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:39.629493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:39.629528 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:39.629573 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:39.629890 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.630667 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.631700 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:39.632025 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:39.632082 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:39.634667 (+ 2585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:39.634668 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:39.634668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:39.634675 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:39.636744 (+ 2069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.637135 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.637136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.637136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.637193 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:39.637405 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:39.637406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:39.637406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:39.637540 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:39.637605 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:39.637771 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 01:16:39.637852 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 01:16:39.639775 10693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e: Bootstrap starting.
I20260812 01:16:39.640638 10693 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:39.640967 10693 log.cc:824] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:39.641939 10693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e: No bootstrap required, opened a new log
I20260812 01:16:39.643998 10693 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } }
I20260812 01:16:39.644153 10693 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:39.644188 10693 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63453dd7961b44ee8e3e2cc6b9132a8e, State: Initialized, Role: FOLLOWER
I20260812 01:16:39.644325 10693 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } }
I20260812 01:16:39.644706 10693 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [sys.catalog]: configured and running, proceeding with master startup.
W20260812 01:16:39.646612 10936 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:16:39.646718 10936 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:16:39.648415 10573 master_runner.cc:263] No leader master found from master 63453dd7961b44ee8e3e2cc6b9132a8e
I20260812 01:16:39.648480 10573 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:16:39.648677 10913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } } }
I20260812 01:16:39.648764 10913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [sys.catalog]: This master's current role is: FOLLOWER
W20260812 01:16:39.742511 10474 tablet.cc:2369] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:16:39.777217 10882 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:16:39.777385 10882 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } }
I20260812 01:16:39.777630 10882 leader_election.cc:288] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2026a00a29f7482f89d76450036f87b1 (127.17.183.190:33457), 63453dd7961b44ee8e3e2cc6b9132a8e (127.17.183.189:39191)
I20260812 01:16:39.778035 10511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9d164ad1f1a4d269701daae52e854c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2026a00a29f7482f89d76450036f87b1" is_pre_election: true
I20260812 01:16:39.778214 10511 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9d164ad1f1a4d269701daae52e854c7 in term 0.
I20260812 01:16:39.778137 10643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9d164ad1f1a4d269701daae52e854c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" is_pre_election: true
I20260812 01:16:39.778313 10643 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9d164ad1f1a4d269701daae52e854c7 in term 0.
I20260812 01:16:39.778524 10735 leader_election.cc:302] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63453dd7961b44ee8e3e2cc6b9132a8e, e9d164ad1f1a4d269701daae52e854c7; no voters:
I20260812 01:16:39.778741 10882 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:16:39.778806 10882 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:16:39.778833 10882 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:39.779816 10882 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } }
I20260812 01:16:39.779961 10882 leader_election.cc:288] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [CANDIDATE]: Term 1 election: Requested vote from peers 2026a00a29f7482f89d76450036f87b1 (127.17.183.190:33457), 63453dd7961b44ee8e3e2cc6b9132a8e (127.17.183.189:39191)
I20260812 01:16:39.780153 10643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9d164ad1f1a4d269701daae52e854c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e"
I20260812 01:16:39.780227 10643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:39.780539 10511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9d164ad1f1a4d269701daae52e854c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2026a00a29f7482f89d76450036f87b1"
I20260812 01:16:39.780620 10511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:39.781198 10643 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9d164ad1f1a4d269701daae52e854c7 in term 1.
I20260812 01:16:39.781397 10735 leader_election.cc:302] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63453dd7961b44ee8e3e2cc6b9132a8e, e9d164ad1f1a4d269701daae52e854c7; no voters:
I20260812 01:16:39.781474 10882 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:16:39.781569 10511 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9d164ad1f1a4d269701daae52e854c7 in term 1.
I20260812 01:16:39.781661 10882 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [term 1 LEADER]: Becoming Leader. State: Replica: e9d164ad1f1a4d269701daae52e854c7, State: Running, Role: LEADER
I20260812 01:16:39.781761 10882 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } }
I20260812 01:16:39.782164 10882 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9d164ad1f1a4d269701daae52e854c7. Latest consensus state: current_term: 1 leader_uuid: "e9d164ad1f1a4d269701daae52e854c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } } }
I20260812 01:16:39.782254 10882 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:39.782492 10944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:16:39.782678 10944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:16:39.784720 10643 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [term 1 FOLLOWER]: Refusing update from remote peer e9d164ad1f1a4d269701daae52e854c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:16:39.784776 10511 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [term 1 FOLLOWER]: Refusing update from remote peer e9d164ad1f1a4d269701daae52e854c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:16:39.785063 10938 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:16:39.785172 10882 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:16:39.786432 10851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9d164ad1f1a4d269701daae52e854c7. Latest consensus state: current_term: 1 leader_uuid: "e9d164ad1f1a4d269701daae52e854c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } } }
I20260812 01:16:39.786514 10851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:16:39.786623 10913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9d164ad1f1a4d269701daae52e854c7. Latest consensus state: current_term: 1 leader_uuid: "e9d164ad1f1a4d269701daae52e854c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } } }
I20260812 01:16:39.786736 10913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:16:39.787894 10913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9d164ad1f1a4d269701daae52e854c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } } }
I20260812 01:16:39.787900 10882 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9d164ad1f1a4d269701daae52e854c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } } }
I20260812 01:16:39.787974 10882 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:39.788029 10882 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9d164ad1f1a4d269701daae52e854c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } } }
I20260812 01:16:39.788062 10882 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:39.788219 10946 mvcc.cc:205] Tried to move back new op lower bound from 7317493349515497472 to 7317493349506764800. Current Snapshot: MvccSnapshot[applied={T|T < 7317493349515497472}]
I20260812 01:16:39.788442 10851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9d164ad1f1a4d269701daae52e854c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2026a00a29f7482f89d76450036f87b1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33457 } } peers { permanent_uuid: "63453dd7961b44ee8e3e2cc6b9132a8e" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39191 } } peers { permanent_uuid: "e9d164ad1f1a4d269701daae52e854c7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 38521 } } }
I20260812 01:16:39.788537 10851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:16:39.788599 10950 mvcc.cc:205] Tried to move back new op lower bound from 7317493349515497472 to 7317493349506764800. Current Snapshot: MvccSnapshot[applied={T|T < 7317493349515497472}]
I20260812 01:16:39.788723 10913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:16:39.789558 10944 catalog_manager.cc:1347] Generated new cluster ID: 5228bf69a88b40df9ed767f6af49fa12
I20260812 01:16:39.789614 10944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:16:39.801440 10944 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:16:39.802224 10944 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:16:39.813004 10944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9d164ad1f1a4d269701daae52e854c7: Generated new TSK 0
I20260812 01:16:39.813198 10944 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:16:40.610674 10879 catalog_manager.cc:1259] Loaded cluster ID: 5228bf69a88b40df9ed767f6af49fa12
I20260812 01:16:40.610750 10879 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1: loading cluster ID for follower catalog manager: success
I20260812 01:16:40.611603 10879 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1: acquiring CA information for follower catalog manager: success
I20260812 01:16:40.611891 10879 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2026a00a29f7482f89d76450036f87b1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:16:40.647194 10936 catalog_manager.cc:1259] Loaded cluster ID: 5228bf69a88b40df9ed767f6af49fa12
I20260812 01:16:40.647284 10936 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e: loading cluster ID for follower catalog manager: success
I20260812 01:16:40.648097 10936 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e: acquiring CA information for follower catalog manager: success
I20260812 01:16:40.648443 10936 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 63453dd7961b44ee8e3e2cc6b9132a8e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:16:40.864876 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 10428
I20260812 01:16:40.883409 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 10573
I20260812 01:16:40.896252 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 10703
2026-08-12T01:16:40Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3174 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:16:40 dist-test-slave-rwrg krb5kdc[10984](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:16:40 dist-test-slave-rwrg krb5kdc[10984](info): set up 2 sockets
Aug 12 01:16:40 dist-test-slave-rwrg krb5kdc[10984](info): commencing operation
krb5kdc: starting...
W20260812 01:16:42.184563 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:16:42 dist-test-slave-rwrg krb5kdc[10984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:16:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:16:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:16:42.303578 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43457
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:45901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:43457
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:42.385028 11004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:42.385210 11004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:42.385229 11004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:42.386265 11004 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:16:42.386313 11004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:42.386327 11004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:42.386337 11004 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:16:42.386382 11004 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:16:42.387737 11004 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:45901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:43457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:42.387974 11004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:42.388212 11004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:42.392915 11009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:42.392920 11021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:42.392935 11015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:42.393224 11004 server_base.cc:1034] running on GCE node
I20260812 01:16:42.393472 11004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:42.393788 11004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:42.394930 11004 hybrid_clock.cc:648] HybridClock initialized: now 1786497402394913 us; error 41 us; skew 500 ppm
Aug 12 01:16:42 dist-test-slave-rwrg krb5kdc[10984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497402, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:42.397439 11004 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:16:42.397872 11004 webserver.cc:460] Webserver started at http://127.17.183.190:43109/ using document root <none> and password file <none>
I20260812 01:16:42.398113 11004 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:42.398156 11004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:42.398306 11004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:16:42.399335 11004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "2e9d463855584096a6130cd441827861"
format_stamp: "Formatted at 2026-08-12 01:16:42 on dist-test-slave-rwrg"
server_key: "79be937709005df299276e8d551f7e62"
server_key_iv: "99f9593ca81f808e1ccb72bb34866a0b"
server_key_version: "encryptionkey@0"
I20260812 01:16:42.399688 11004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "2e9d463855584096a6130cd441827861"
format_stamp: "Formatted at 2026-08-12 01:16:42 on dist-test-slave-rwrg"
server_key: "79be937709005df299276e8d551f7e62"
server_key_iv: "99f9593ca81f808e1ccb72bb34866a0b"
server_key_version: "encryptionkey@0"
I20260812 01:16:42.401096 11004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:16:42.401785 11029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:42.401955 11004 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:16:42.402060 11004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "2e9d463855584096a6130cd441827861"
format_stamp: "Formatted at 2026-08-12 01:16:42 on dist-test-slave-rwrg"
server_key: "79be937709005df299276e8d551f7e62"
server_key_iv: "99f9593ca81f808e1ccb72bb34866a0b"
server_key_version: "encryptionkey@0"
I20260812 01:16:42.402134 11004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:42.417321 11004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:42.419260 11004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:42.419427 11004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:42.423789 11004 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:43457
I20260812 01:16:42.423828 11123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:43457 every 8 connection(s)
I20260812 01:16:42.424229 11004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:16:42.425177 11125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:42.427469 11125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861: Bootstrap starting.
I20260812 01:16:42.428000 11125 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:42.428234 11125 log.cc:824] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:42.428666 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 11004
I20260812 01:16:42.428800 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:16:42.429001 18142 external_mini_cluster.cc:1428] Setting key 5394b95d232a77d8b30d44a77f355448
I20260812 01:16:42.429112 11125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861: No bootstrap required, opened a new log
I20260812 01:16:42.431362 11125 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9d463855584096a6130cd441827861" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43457 } }
I20260812 01:16:42.431545 11125 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:42.431586 11125 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e9d463855584096a6130cd441827861, State: Initialized, Role: FOLLOWER
I20260812 01:16:42.431738 11125 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9d463855584096a6130cd441827861" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43457 } }
I20260812 01:16:42.431824 11125 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:16:42.431857 11125 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:16:42.431903 11125 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:42.432667 11125 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9d463855584096a6130cd441827861" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43457 } }
I20260812 01:16:42.432776 11125 leader_election.cc:302] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e9d463855584096a6130cd441827861; no voters:
I20260812 01:16:42.432932 11125 leader_election.cc:288] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:16:42.433001 11131 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:16:42.433180 11131 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [term 1 LEADER]: Becoming Leader. State: Replica: 2e9d463855584096a6130cd441827861, State: Running, Role: LEADER
I20260812 01:16:42.433180 11125 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:16:42.433291 11131 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9d463855584096a6130cd441827861" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43457 } }
I20260812 01:16:42.433617 11133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e9d463855584096a6130cd441827861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9d463855584096a6130cd441827861" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43457 } } }
I20260812 01:16:42.433602 11131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e9d463855584096a6130cd441827861. Latest consensus state: current_term: 1 leader_uuid: "2e9d463855584096a6130cd441827861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9d463855584096a6130cd441827861" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43457 } } }
I20260812 01:16:42.433749 11133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:42.433764 11131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:42.434165 11145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:16:42.434702 11145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:16:42.436369 11145 catalog_manager.cc:1347] Generated new cluster ID: 2324dbfa9f124ca0a3547e1901c647ff
I20260812 01:16:42.436424 11145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:16:42 dist-test-slave-rwrg krb5kdc[10984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:42.440984 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:42.429517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54700 (local address 127.17.183.190:43457)
0812 01:16:42.429727 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:42.429738 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:42.429777 (+ 39us) server_negotiation.cc:407] Connection header received
0812 01:16:42.430547 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:42.430557 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:42.430628 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:42.430781 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:42.431386 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:42.433124 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:42.434322 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:42.434920 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:42.435031 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:42.437733 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:42.437737 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:42.437738 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:42.437750 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:42.439488 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:42.439824 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:42.439827 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:42.439827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:42.439927 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:42.440103 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:42.440103 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:42.440104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:42.440382 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:42.440520 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:42.440674 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 01:16:42.440796 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":91,"threads_started":1}
I20260812 01:16:42.441978 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:16:42.480690 11145 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:16:42.481442 11145 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:16:42.484829 11145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e9d463855584096a6130cd441827861: Generated new TSK 0
I20260812 01:16:42.485081 11145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:16:42.496738 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 11004
2026-08-12T01:16:42Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1605 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:16:42 dist-test-slave-rwrg krb5kdc[11173](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:16:42 dist-test-slave-rwrg krb5kdc[11173](info): set up 2 sockets
Aug 12 01:16:42 dist-test-slave-rwrg krb5kdc[11173](info): commencing operation
krb5kdc: starting...
W20260812 01:16:43.801446 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:16:43 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:16:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:16:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:16:43.919009 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44861
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:44861
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:44.003353 11201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:44.003607 11201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:44.003644 11201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:44.004820 11201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:16:44.004891 11201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:44.004915 11201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:44.004935 11201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:16:44.004966 11201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:16:44.006472 11201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:44861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:44.006772 11201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:44.007007 11201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:44.012100 11214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:44.012094 11211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:44.012394 11201 server_base.cc:1034] running on GCE node
W20260812 01:16:44.012094 11218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:44.012761 11201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:44.013007 11201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:44.014153 11201 hybrid_clock.cc:648] HybridClock initialized: now 1786497404014123 us; error 47 us; skew 500 ppm
Aug 12 01:16:44 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497404, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:44.016824 11201 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:16:44.017303 11201 webserver.cc:460] Webserver started at http://127.17.183.190:42933/ using document root <none> and password file <none>
I20260812 01:16:44.017561 11201 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:44.017606 11201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:44.017771 11201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:16:44.018838 11201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "f334583d763d4d569185ad9c00694e19"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "7974417d770dfb8cba8b012de96c36db"
server_key_iv: "58938957a378a8645698adb8300eb617"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.019210 11201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "f334583d763d4d569185ad9c00694e19"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "7974417d770dfb8cba8b012de96c36db"
server_key_iv: "58938957a378a8645698adb8300eb617"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.020591 11201 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 01:16:44.021382 11232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:44.021570 11201 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:44.021639 11201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "f334583d763d4d569185ad9c00694e19"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "7974417d770dfb8cba8b012de96c36db"
server_key_iv: "58938957a378a8645698adb8300eb617"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.021731 11201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:44.042603 11201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:44.044605 11201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:44.044797 11201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:44.049070 11201 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:44861
I20260812 01:16:44.049144 11319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:44861 every 8 connection(s)
I20260812 01:16:44.049503 11201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:16:44.050565 11321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:44.053069 11321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Bootstrap starting.
I20260812 01:16:44.053608 11321 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:44.053862 11321 log.cc:824] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:44.054235 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 11201
I20260812 01:16:44.054388 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:16:44.054626 18142 external_mini_cluster.cc:1428] Setting key 535e6b575d27d1a690a12b07c3461cf1
I20260812 01:16:44.054637 11321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: No bootstrap required, opened a new log
I20260812 01:16:44.056552 11321 raft_consensus.cc:348] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:44.056723 11321 raft_consensus.cc:374] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:44.056774 11321 raft_consensus.cc:729] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f334583d763d4d569185ad9c00694e19, State: Initialized, Role: FOLLOWER
I20260812 01:16:44.056902 11321 consensus_queue.cc:260] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:44.056991 11321 raft_consensus.cc:388] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:16:44.057052 11321 raft_consensus.cc:482] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:16:44.057103 11321 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:44.058120 11321 raft_consensus.cc:504] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:44.058215 11321 leader_election.cc:302] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f334583d763d4d569185ad9c00694e19; no voters:
I20260812 01:16:44.058439 11321 leader_election.cc:288] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:16:44.058459 11327 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:16:44.058609 11327 raft_consensus.cc:686] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 1 LEADER]: Becoming Leader. State: Replica: f334583d763d4d569185ad9c00694e19, State: Running, Role: LEADER
I20260812 01:16:44.058738 11321 sys_catalog.cc:564] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:16:44.058772 11327 consensus_queue.cc:237] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:44.060055 11330 sys_catalog.cc:455] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f334583d763d4d569185ad9c00694e19. Latest consensus state: current_term: 1 leader_uuid: "f334583d763d4d569185ad9c00694e19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } } }
I20260812 01:16:44.060168 11330 sys_catalog.cc:458] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:44.060343 11360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:16:44.060381 11328 sys_catalog.cc:455] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f334583d763d4d569185ad9c00694e19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } } }
I20260812 01:16:44.060467 11328 sys_catalog.cc:458] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:44.060907 11360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:16:44.062664 11360 catalog_manager.cc:1347] Generated new cluster ID: 73eeeba4af0042f3ba25b79829cbeecf
I20260812 01:16:44.062716 11360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:16:44 dist-test-slave-rwrg krb5kdc[11173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:44.067580 11326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.055177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44596 (local address 127.17.183.190:44861)
0812 01:16:44.055414 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:44.055422 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:44.055447 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:16:44.056530 (+ 1083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:44.056545 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:44.056602 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:44.056754 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:44.057559 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.058745 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.059893 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.060617 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.060727 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.063646 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:44.063649 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:44.063649 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:44.063661 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:44.065623 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:44.066006 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:44.066009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:44.066009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:44.066132 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:44.066319 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:44.066320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:44.066320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:44.066590 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:44.066721 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:44.067240 (+ 519us) server_negotiation.cc:299] Negotiation successful
0812 01:16:44.067371 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":135,"threads_started":1}
I20260812 01:16:44.081276 11360 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:16:44.082069 11360 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:16:44.087071 11360 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Generated new TSK 0
I20260812 01:16:44.087266 11360 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:16:44.115561 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:44861
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:44.201421 11369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:44.201664 11369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:44.201705 11369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:44.202858 11369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:44.202950 11369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:44.203001 11369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:16:44.204569 11369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:44861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:44.204861 11369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:44.205099 11369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:44.213172 11383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:44.213192 11387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:44.213234 11385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:44.213510 11369 server_base.cc:1034] running on GCE node
I20260812 01:16:44.213745 11369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:44.214041 11369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:44.215197 11369 hybrid_clock.cc:648] HybridClock initialized: now 1786497404215171 us; error 37 us; skew 500 ppm
Aug 12 01:16:44 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497404, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:44.217811 11369 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:16:44.218227 11369 webserver.cc:460] Webserver started at http://127.17.183.129:34571/ using document root <none> and password file <none>
I20260812 01:16:44.218470 11369 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:44.218515 11369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:44.218680 11369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:16:44.219748 11369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "2cf9627e384e44cfb133df7fc308abc2"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "979486a002d462e85364721d4736b051"
server_key_iv: "2929fd50980f75d18548a93ef635890c"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.220117 11369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "2cf9627e384e44cfb133df7fc308abc2"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "979486a002d462e85364721d4736b051"
server_key_iv: "2929fd50980f75d18548a93ef635890c"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.221551 11369 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:16:44.222319 11399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:44.222528 11369 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:44.222623 11369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "2cf9627e384e44cfb133df7fc308abc2"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "979486a002d462e85364721d4736b051"
server_key_iv: "2929fd50980f75d18548a93ef635890c"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.222677 11369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:44.252424 11369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:44.254743 11369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:44.254866 11369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:44.255046 11369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:44.255390 11369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:44.255424 11369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:44.255445 11369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:44.255491 11369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:44.261757 11369 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:45573
I20260812 01:16:44.261864 11603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:45573 every 8 connection(s)
I20260812 01:16:44.262163 11369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
Aug 12 01:16:44 dist-test-slave-rwrg krb5kdc[11173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497404, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:44.271348 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 11369
I20260812 01:16:44.271477 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:16:44.271535 11326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.263069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:50097 (local address 127.17.183.190:44861)
0812 01:16:44.263134 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:44.263136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:44.263359 (+ 223us) server_negotiation.cc:407] Connection header received
0812 01:16:44.263904 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:44.263906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:44.263923 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:44.263976 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:44.265040 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.265543 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.266530 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.266819 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.266898 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.268958 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:44.268959 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:44.268959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:44.268967 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:44.270217 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:44.270609 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:44.270610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:44.270610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:44.270661 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:44.270880 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:44.270881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:44.270881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:44.270986 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:44.271036 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:44.271342 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 01:16:44.271442 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 01:16:44.271675 11610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.263047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:50097)
0812 01:16:44.263226 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:44.263265 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:44.263789 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:44.264052 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:44.264056 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:44.264716 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:44.264932 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.264938 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.265644 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.265645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.266420 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.266422 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.266923 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.266924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.267045 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.267485 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:44.267493 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:44.268861 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:44.270293 (+ 1432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:44.270300 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:44.270302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:44.270524 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:44.270723 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:44.270724 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:44.270724 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:44.270825 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:44.271042 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:44.271047 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:44.271154 (+ 107us) client_negotiation.cc:769] Sending connection context
0812 01:16:44.271295 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 01:16:44.271454 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":93,"threads_started":1}
I20260812 01:16:44.271737 18142 external_mini_cluster.cc:1428] Setting key bdbeac8a28fe48c2794e58376d1c9a7b
I20260812 01:16:44.272388 11606 heartbeater.cc:347] Connected to a master server at 127.17.183.190:44861
I20260812 01:16:44.272527 11606 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:44.272724 11606 heartbeater.cc:511] Master 127.17.183.190:44861 requested a full tablet report, sending...
I20260812 01:16:44.273411 11261 ts_manager.cc:194] Registered new tserver with Master: 2cf9627e384e44cfb133df7fc308abc2 (127.17.183.129:45573)
I20260812 01:16:44.274200 11261 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:50097
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:16:44.297225 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:44861
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:44.379228 11619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:44.379462 11619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:44.379501 11619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:44.380672 11619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:44.380739 11619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:44.380787 11619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:16:44.382303 11619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:44861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:44.382570 11619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:44.382822 11619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:44.387944 11629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:44.387933 11632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:44.388013 11619 server_base.cc:1034] running on GCE node
W20260812 01:16:44.387930 11630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:44.388392 11619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:44.388657 11619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:44.389824 11619 hybrid_clock.cc:648] HybridClock initialized: now 1786497404389796 us; error 46 us; skew 500 ppm
Aug 12 01:16:44 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497404, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:44.392288 11619 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:16:44.392758 11619 webserver.cc:460] Webserver started at http://127.17.183.130:41285/ using document root <none> and password file <none>
I20260812 01:16:44.392980 11619 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:44.393045 11619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:44.393205 11619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:16:44.394246 11619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "70c9e6ceb12c4e4bb787156bbe052e98"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "74c1bdedd1a09f2be2583ae7a65f6369"
server_key_iv: "7e0d67dca2ab98d2334dc53738828342"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.394613 11619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "70c9e6ceb12c4e4bb787156bbe052e98"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "74c1bdedd1a09f2be2583ae7a65f6369"
server_key_iv: "7e0d67dca2ab98d2334dc53738828342"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.395893 11619 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:16:44.396646 11642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:44.396824 11619 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:16:44.396924 11619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "70c9e6ceb12c4e4bb787156bbe052e98"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "74c1bdedd1a09f2be2583ae7a65f6369"
server_key_iv: "7e0d67dca2ab98d2334dc53738828342"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.397008 11619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:44.431440 11619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:44.433914 11619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:44.434091 11619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:44.434345 11619 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:44.434685 11619 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:44.434747 11619 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:44.434793 11619 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:44.434824 11619 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:44.441052 11619 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:37021
I20260812 01:16:44.441107 11848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:37021 every 8 connection(s)
I20260812 01:16:44.441479 11619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:16:44.442689 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 11619
I20260812 01:16:44.442777 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:16:44.442972 18142 external_mini_cluster.cc:1428] Setting key 5eeb97c7fb8ab501c87210cd8c754943
Aug 12 01:16:44 dist-test-slave-rwrg krb5kdc[11173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497404, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:44.451929 11326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.442396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:50763 (local address 127.17.183.190:44861)
0812 01:16:44.442447 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:44.442449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:44.442570 (+ 121us) server_negotiation.cc:407] Connection header received
0812 01:16:44.443220 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:44.443221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:44.443232 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:44.443279 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:44.444446 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.445252 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.446271 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.446593 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.446668 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.449037 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:44.449038 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:44.449038 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:44.449045 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:44.450464 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:44.450968 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:44.450969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:44.450969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:44.451021 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:44.451304 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:44.451304 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:44.451305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:44.451404 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:44.451454 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:44.451798 (+ 344us) server_negotiation.cc:299] Negotiation successful
0812 01:16:44.451864 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 01:16:44.452265 11856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.442225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:50763)
0812 01:16:44.442405 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:44.442449 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:44.443078 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:44.443429 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:44.443433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:44.444134 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:44.444342 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.444347 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.445349 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.445350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.446175 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.446177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.446682 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.446683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.446792 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.447316 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:44.447325 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:44.448924 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:44.450552 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:44.450560 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:44.450562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:44.450887 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:44.451089 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:44.451090 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:44.451091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:44.451235 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:44.451471 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:44.451479 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:44.451658 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 01:16:44.451782 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 01:16:44.451951 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":95,"threads_started":1}
I20260812 01:16:44.452943 11849 heartbeater.cc:347] Connected to a master server at 127.17.183.190:44861
I20260812 01:16:44.453034 11849 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
I20260812 01:16:44.453229 11849 heartbeater.cc:511] Master 127.17.183.190:44861 requested a full tablet report, sending...
I20260812 01:16:44.453742 11261 ts_manager.cc:194] Registered new tserver with Master: 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021)
I20260812 01:16:44.454247 11261 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:50763
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:16:44.469574 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:44861
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:44.552176 11862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:44.552415 11862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:44.552457 11862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:44.553630 11862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:44.553702 11862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:44.553755 11862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:16:44.555359 11862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:44861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:44.555635 11862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:44.555883 11862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:44.560976 11877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:44.560989 11871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:44.561036 11872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:44.561275 11862 server_base.cc:1034] running on GCE node
I20260812 01:16:44.561455 11862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:44.561631 11862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:44.562776 11862 hybrid_clock.cc:648] HybridClock initialized: now 1786497404562763 us; error 26 us; skew 500 ppm
Aug 12 01:16:44 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497404, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:44.565263 11862 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:16:44.565733 11862 webserver.cc:460] Webserver started at http://127.17.183.131:33507/ using document root <none> and password file <none>
I20260812 01:16:44.565922 11862 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:44.565961 11862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:44.566092 11862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:16:44.567083 11862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "a98291b969c94fa8b5b2e981dc5ad61c"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "ba430952066266df6a8b0f91bb31326a"
server_key_iv: "9ab4b16e95342496e51589fd1d44add3"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.567476 11862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "a98291b969c94fa8b5b2e981dc5ad61c"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "ba430952066266df6a8b0f91bb31326a"
server_key_iv: "9ab4b16e95342496e51589fd1d44add3"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.568866 11862 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:16:44.569641 11896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:44.569826 11862 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:16:44.569936 11862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "a98291b969c94fa8b5b2e981dc5ad61c"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "ba430952066266df6a8b0f91bb31326a"
server_key_iv: "9ab4b16e95342496e51589fd1d44add3"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.570012 11862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:44.591465 11862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:44.593667 11862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:44.593873 11862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:44.594161 11862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:44.594525 11862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:44.594586 11862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:44.594636 11862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:44.594663 11862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:44.602258 11862 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:35787
I20260812 01:16:44.602295 12116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:35787 every 8 connection(s)
I20260812 01:16:44.602664 11862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:16:44.604452 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 11862
I20260812 01:16:44.604561 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:16:44.604732 18142 external_mini_cluster.cc:1428] Setting key 906923782c484cf540a125bb911b1840
Aug 12 01:16:44 dist-test-slave-rwrg krb5kdc[11173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497404, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:44.612883 11326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.603600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:52607 (local address 127.17.183.190:44861)
0812 01:16:44.603645 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:44.603647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:44.603904 (+ 257us) server_negotiation.cc:407] Connection header received
0812 01:16:44.604444 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:44.604446 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:44.604458 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:44.604547 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:44.606020 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.606508 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.607680 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.607861 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.607914 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.610066 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:44.610067 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:44.610068 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:44.610074 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:44.611648 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:44.612017 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:44.612018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:44.612018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:44.612069 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:44.612288 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:44.612289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:44.612289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:44.612391 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:44.612442 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:44.612755 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 01:16:44.612819 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 01:16:44.613060 12124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.603570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:52607)
0812 01:16:44.603760 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:44.603807 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:44.604346 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:44.604656 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:44.604660 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:44.605626 (+ 966us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:44.605926 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.605932 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.606786 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.606788 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.607601 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.607603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.607942 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.607943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.608043 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.608559 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:44.608568 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:44.609983 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:44.611720 (+ 1737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:44.611727 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:44.611729 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:44.611952 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:44.612131 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:44.612131 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:44.612132 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:44.612230 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:44.612448 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:44.612452 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:44.612637 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 01:16:44.612724 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 01:16:44.612854 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":109,"threads_started":1}
I20260812 01:16:44.613504 12117 heartbeater.cc:347] Connected to a master server at 127.17.183.190:44861
I20260812 01:16:44.613641 12117 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:44.613827 12117 heartbeater.cc:511] Master 127.17.183.190:44861 requested a full tablet report, sending...
I20260812 01:16:44.614248 11261 ts_manager.cc:194] Registered new tserver with Master: a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787)
I20260812 01:16:44.614584 11261 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:52607
I20260812 01:16:44.616482 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:16:44.623405 11326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.617751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58208 (local address 127.17.183.190:44861)
0812 01:16:44.617788 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:44.617790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:44.617904 (+ 114us) server_negotiation.cc:407] Connection header received
0812 01:16:44.617977 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:44.617978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:44.617987 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:44.618058 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:44.618595 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.619079 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.619825 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.620028 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.620103 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.621235 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:44.621236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:44.621237 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:44.621244 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:44.622307 (+ 1063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:44.622626 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:44.622627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:44.622628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:44.622682 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:44.622889 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:44.622890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:44.622890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:44.623029 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:44.623132 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:44.623241 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 01:16:44.623312 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 01:16:44.624840 11261 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:16:44.626510 11261 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:16:44.633057 12135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.629036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:37021 (local address 127.0.0.1:34992)
0812 01:16:44.629280 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:44.629290 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:44.629349 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:44.629746 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:44.629747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:44.629749 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:44.629795 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.629798 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.630658 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.630659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.631907 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.631910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.632746 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.632747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.632825 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.632844 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 01:16:44.632931 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 01:16:44.632985 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":83,"threads_started":1}
I20260812 01:16:44.633071 12144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.629275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34992 (local address 127.17.183.130:37021)
0812 01:16:44.629483 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:44.629487 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:44.629497 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:16:44.629537 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:44.629539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:44.629553 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:44.629661 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:44.629866 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.630556 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.632002 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.632659 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.632748 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.632807 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:44.632952 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 01:16:44.632994 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":99,"threads_started":1}
I20260812 01:16:44.633188 12136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.628805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:35787 (local address 127.0.0.1:52850)
0812 01:16:44.629100 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:44.629154 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:44.629235 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:44.629756 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:44.629757 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:44.629759 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:44.629798 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.629801 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.631034 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.631035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.631965 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.631968 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.632962 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.632963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.633027 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.633032 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:16:44.633062 (+ 30us) client_negotiation.cc:240] Negotiation successful
0812 01:16:44.633104 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":82,"threads_started":1}
I20260812 01:16:44.633299 12141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.628818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45573 (local address 127.0.0.1:43224)
0812 01:16:44.629173 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:44.629183 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:44.629235 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:44.629522 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:44.629526 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:44.629529 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:44.629597 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.629599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.630966 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.630967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.632109 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.632111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.633090 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.633091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.633157 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.633160 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:16:44.633206 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 01:16:44.633243 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":33,"thread_start_us":115,"threads_started":1}
I20260812 01:16:44.633510 12138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.628903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52850 (local address 127.17.183.131:35787)
0812 01:16:44.629176 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:44.629179 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:44.629442 (+ 263us) server_negotiation.cc:407] Connection header received
0812 01:16:44.629629 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:44.629632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:44.629650 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:44.629870 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:44.629925 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.630948 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.632061 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.632851 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.633276 (+ 425us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.633340 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:44.633372 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 01:16:44.633421 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":92,"threads_started":1}
I20260812 01:16:44.633565 12137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.628909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43224 (local address 127.17.183.129:45573)
0812 01:16:44.629087 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:44.629092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:44.629341 (+ 249us) server_negotiation.cc:407] Connection header received
0812 01:16:44.629398 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:44.629401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:44.629419 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:44.629502 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:44.629692 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.630847 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.632183 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.632943 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.633006 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.633058 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:44.633440 (+ 382us) server_negotiation.cc:299] Negotiation successful
0812 01:16:44.633480 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
I20260812 01:16:44.634207 11725 tablet_service.cc:1467] Processing CreateTablet for tablet dc53f476258249b2b7801cbb50c6c769 (DEFAULT_TABLE table=test-table [id=b4dc2b7bb3fa43d98551673edaa66bdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:16:44.634305 11489 tablet_service.cc:1467] Processing CreateTablet for tablet dc53f476258249b2b7801cbb50c6c769 (DEFAULT_TABLE table=test-table [id=b4dc2b7bb3fa43d98551673edaa66bdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:16:44.634305 11984 tablet_service.cc:1467] Processing CreateTablet for tablet dc53f476258249b2b7801cbb50c6c769 (DEFAULT_TABLE table=test-table [id=b4dc2b7bb3fa43d98551673edaa66bdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:16:44.634613 11725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc53f476258249b2b7801cbb50c6c769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:44.634637 11984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc53f476258249b2b7801cbb50c6c769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:44.634637 11489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc53f476258249b2b7801cbb50c6c769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:44.637351 12146 tablet_bootstrap.cc:492] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: Bootstrap starting.
I20260812 01:16:44.637883 12147 tablet_bootstrap.cc:492] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Bootstrap starting.
I20260812 01:16:44.638046 12146 tablet_bootstrap.cc:654] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:44.638341 12148 tablet_bootstrap.cc:492] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c: Bootstrap starting.
I20260812 01:16:44.638646 12147 tablet_bootstrap.cc:654] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:44.638675 12146 log.cc:824] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:44.638967 12148 tablet_bootstrap.cc:654] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:44.639271 12147 log.cc:824] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:44.639559 12146 tablet_bootstrap.cc:492] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: No bootstrap required, opened a new log
I20260812 01:16:44.639657 12146 ts_tablet_manager.cc:1397] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:16:44.639652 12148 log.cc:824] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:44.640074 12147 tablet_bootstrap.cc:492] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: No bootstrap required, opened a new log
I20260812 01:16:44.640218 12147 ts_tablet_manager.cc:1397] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:16:44.640425 12148 tablet_bootstrap.cc:492] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c: No bootstrap required, opened a new log
I20260812 01:16:44.640560 12148 ts_tablet_manager.cc:1397] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:16:44.641855 12148 raft_consensus.cc:348] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:44.642005 12148 raft_consensus.cc:374] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:44.641958 12146 raft_consensus.cc:348] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:44.642068 12148 raft_consensus.cc:729] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a98291b969c94fa8b5b2e981dc5ad61c, State: Initialized, Role: FOLLOWER
I20260812 01:16:44.642131 12146 raft_consensus.cc:374] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:44.642215 12146 raft_consensus.cc:729] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c9e6ceb12c4e4bb787156bbe052e98, State: Initialized, Role: FOLLOWER
I20260812 01:16:44.642227 12148 consensus_queue.cc:260] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:44.642282 12147 raft_consensus.cc:348] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:44.642400 12146 consensus_queue.cc:260] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:44.642527 12117 heartbeater.cc:503] Master 127.17.183.190:44861 was elected leader, sending a full tablet report...
I20260812 01:16:44.642531 12147 raft_consensus.cc:374] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:44.642536 12148 ts_tablet_manager.cc:1428] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:16:44.642592 12147 raft_consensus.cc:729] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cf9627e384e44cfb133df7fc308abc2, State: Initialized, Role: FOLLOWER
I20260812 01:16:44.642699 12146 ts_tablet_manager.cc:1428] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:16:44.642707 12147 consensus_queue.cc:260] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:44.642807 11849 heartbeater.cc:503] Master 127.17.183.190:44861 was elected leader, sending a full tablet report...
I20260812 01:16:44.643009 12147 ts_tablet_manager.cc:1428] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:16:44.643121 11606 heartbeater.cc:503] Master 127.17.183.190:44861 was elected leader, sending a full tablet report...
I20260812 01:16:44.669806 12157 raft_consensus.cc:482] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:16:44.669922 12157 raft_consensus.cc:504] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:44.670243 12157 leader_election.cc:288] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787), 2cf9627e384e44cfb133df7fc308abc2 (127.17.183.129:45573)
I20260812 01:16:44.673122 12137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.670535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:56841 (local address 127.17.183.129:45573)
0812 01:16:44.670614 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:44.670616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:44.670624 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:16:44.670646 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:44.670647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:44.670654 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:44.670728 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:44.670893 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.671367 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.672289 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.672793 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.672873 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.672882 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:44.673022 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 01:16:44.673056 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 01:16:44.673130 11856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.670429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45573 (local address 127.17.183.130:56841)
0812 01:16:44.670475 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:44.670486 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:44.670533 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:44.670750 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:44.670752 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:44.670754 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:44.670824 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.670826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.671452 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.671453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.672179 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.672180 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.672872 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.672873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.672951 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.672954 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:16:44.673017 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 01:16:44.673056 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 01:16:44.673491 11524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc53f476258249b2b7801cbb50c6c769" candidate_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cf9627e384e44cfb133df7fc308abc2" is_pre_election: true
I20260812 01:16:44.673647 12138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.670540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:33009 (local address 127.17.183.131:35787)
0812 01:16:44.670608 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:44.670610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:44.670875 (+ 265us) server_negotiation.cc:407] Connection header received
0812 01:16:44.670946 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:44.670947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:44.670956 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:44.671002 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:44.671166 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.671627 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.672772 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.673202 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.673281 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.673290 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:44.673521 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 01:16:44.673569 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 01:16:44.673696 11524 raft_consensus.cc:2454] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c9e6ceb12c4e4bb787156bbe052e98 in term 0.
I20260812 01:16:44.673856 12160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.670430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:35787 (local address 127.17.183.130:33009)
0812 01:16:44.670793 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:44.670803 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:44.670883 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:44.671003 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:44.671004 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:44.671005 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:44.671085 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.671086 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.671715 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.671716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.672669 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:44.672672 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.673282 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.673283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:44.673367 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.673371 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:16:44.673726 (+ 355us) client_negotiation.cc:240] Negotiation successful
0812 01:16:44.673772 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":173,"thread_start_us":130,"threads_started":1}
I20260812 01:16:44.674021 11649 leader_election.cc:302] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cf9627e384e44cfb133df7fc308abc2, 70c9e6ceb12c4e4bb787156bbe052e98; no voters:
I20260812 01:16:44.674185 12157 raft_consensus.cc:2781] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:16:44.674257 12157 raft_consensus.cc:482] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:16:44.674286 12157 raft_consensus.cc:3037] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:44.674268 12021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc53f476258249b2b7801cbb50c6c769" candidate_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" is_pre_election: true
I20260812 01:16:44.674412 12021 raft_consensus.cc:2454] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c9e6ceb12c4e4bb787156bbe052e98 in term 0.
I20260812 01:16:44.675071 12157 raft_consensus.cc:504] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:44.675205 12157 leader_election.cc:288] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [CANDIDATE]: Term 1 election: Requested vote from peers a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787), 2cf9627e384e44cfb133df7fc308abc2 (127.17.183.129:45573)
I20260812 01:16:44.675366 12021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc53f476258249b2b7801cbb50c6c769" candidate_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a98291b969c94fa8b5b2e981dc5ad61c"
I20260812 01:16:44.675396 11524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc53f476258249b2b7801cbb50c6c769" candidate_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cf9627e384e44cfb133df7fc308abc2"
I20260812 01:16:44.675457 11524 raft_consensus.cc:3037] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:44.675455 12021 raft_consensus.cc:3037] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:44.676465 11524 raft_consensus.cc:2454] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c9e6ceb12c4e4bb787156bbe052e98 in term 1.
I20260812 01:16:44.676465 12021 raft_consensus.cc:2454] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c9e6ceb12c4e4bb787156bbe052e98 in term 1.
I20260812 01:16:44.676685 11644 leader_election.cc:302] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c9e6ceb12c4e4bb787156bbe052e98, a98291b969c94fa8b5b2e981dc5ad61c; no voters:
I20260812 01:16:44.676782 12157 raft_consensus.cc:2781] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:16:44.676934 12157 raft_consensus.cc:686] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 1 LEADER]: Becoming Leader. State: Replica: 70c9e6ceb12c4e4bb787156bbe052e98, State: Running, Role: LEADER
I20260812 01:16:44.677042 12157 consensus_queue.cc:237] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:44.677881 11261 catalog_manager.cc:5495] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130). New cstate: current_term: 1 leader_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } health_report { overall_health: UNKNOWN } } }
I20260812 01:16:44.689803 12144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.687515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35000 (local address 127.17.183.130:37021)
0812 01:16:44.687671 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:44.687673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:44.687681 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:16:44.687738 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:44.687738 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:44.687753 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:44.687809 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:16:44.687932 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.688366 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.689121 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:44.689312 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:44.689359 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:44.689488 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:16:44.689582 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:16:44.689640 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:44.689674 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 01:16:44.689689 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260812 01:16:44.691533 11524 raft_consensus.cc:1261] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Refusing update from remote peer 70c9e6ceb12c4e4bb787156bbe052e98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:16:44.691550 12021 raft_consensus.cc:1261] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c [term 1 FOLLOWER]: Refusing update from remote peer 70c9e6ceb12c4e4bb787156bbe052e98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:16:44.691874 12157 consensus_queue.cc:1035] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 01:16:44.692050 11851 tablet.cc:2369] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:16:44.692063 12161 consensus_queue.cc:1035] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:16:44.694463 12167 mvcc.cc:205] Tried to move back new op lower bound from 7317493369613795328 to 7317493369557766144. Current Snapshot: MvccSnapshot[applied={T|T < 7317493369613795328}]
I20260812 01:16:44.694643 12169 mvcc.cc:205] Tried to move back new op lower bound from 7317493369613795328 to 7317493369557766144. Current Snapshot: MvccSnapshot[applied={T|T < 7317493369613795328}]
I20260812 01:16:44.695469 12171 mvcc.cc:205] Tried to move back new op lower bound from 7317493369613795328 to 7317493369557766144. Current Snapshot: MvccSnapshot[applied={T|T < 7317493369613795328}]
I20260812 01:16:44.696803 11261 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:16:44.696918 11261 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:16:44.697752 11261 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Sending DeleteTablet for 3 replicas of tablet dc53f476258249b2b7801cbb50c6c769
I20260812 01:16:44.698161 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 11369
I20260812 01:16:44.698160 11489 tablet_service.cc:1514] Processing DeleteTablet for tablet dc53f476258249b2b7801cbb50c6c769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:16:44 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:43224
I20260812 01:16:44.698206 11984 tablet_service.cc:1514] Processing DeleteTablet for tablet dc53f476258249b2b7801cbb50c6c769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:16:44 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:52850
I20260812 01:16:44.698423 11725 tablet_service.cc:1514] Processing DeleteTablet for tablet dc53f476258249b2b7801cbb50c6c769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:16:44 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:34992
I20260812 01:16:44.698871 12188 tablet_replica.cc:330] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c: stopping tablet replica
I20260812 01:16:44.699024 12188 raft_consensus.cc:2229] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:16:44.699210 12188 raft_consensus.cc:2258] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:16:44.703866 12188 ts_tablet_manager.cc:1905] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:16:44.706413 12188 ts_tablet_manager.cc:1918] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:16:44.706615 12188 log.cc:1196] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/dc53f476258249b2b7801cbb50c6c769
I20260812 01:16:44.706971 12188 ts_tablet_manager.cc:1939] T dc53f476258249b2b7801cbb50c6c769 P a98291b969c94fa8b5b2e981dc5ad61c: Deleting consensus metadata
I20260812 01:16:44.709807 11233 catalog_manager.cc:4841] TS a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787): tablet dc53f476258249b2b7801cbb50c6c769 (table test-table [id=b4dc2b7bb3fa43d98551673edaa66bdc]) successfully deleted
I20260812 01:16:44.716711 12194 tablet_replica.cc:330] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: stopping tablet replica
I20260812 01:16:44.716878 12194 raft_consensus.cc:2229] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:16:44.717002 12194 raft_consensus.cc:2258] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:16:44.717510 12194 ts_tablet_manager.cc:1905] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:16:44.718895 12194 ts_tablet_manager.cc:1918] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:16:44.719012 12194 log.cc:1196] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/dc53f476258249b2b7801cbb50c6c769
I20260812 01:16:44.719287 12194 ts_tablet_manager.cc:1939] T dc53f476258249b2b7801cbb50c6c769 P 70c9e6ceb12c4e4bb787156bbe052e98: Deleting consensus metadata
I20260812 01:16:44.719748 11233 catalog_manager.cc:4841] TS 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021): tablet dc53f476258249b2b7801cbb50c6c769 (table test-table [id=b4dc2b7bb3fa43d98551673edaa66bdc]) successfully deleted
W20260812 01:16:44.721073 11241 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:45573 (error 108)
I20260812 01:16:44.721271 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 11619
I20260812 01:16:44.728348 12141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:44.728140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45573 (local address 127.0.0.1:43232)
0812 01:16:44.728220 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:44.728298 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:45573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 01:16:44.728637 11241 catalog_manager.cc:4584] TS 2cf9627e384e44cfb133df7fc308abc2 (127.17.183.129:45573): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dc53f476258249b2b7801cbb50c6c769: Network error: Client connection negotiation failed: client connection to 127.17.183.129:45573: connect: Connection refused (error 111)
I20260812 01:16:44.732918 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 11862
I20260812 01:16:44.745190 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 11201
I20260812 01:16:44.757627 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44861
--webserver_interface=127.17.183.190
--webserver_port=42933
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:44861
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:44.839880 12196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:44.840078 12196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:44.840101 12196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:44.841216 12196 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:16:44.841251 12196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:44.841265 12196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:44.841279 12196 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:16:44.841290 12196 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:16:44.842772 12196 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:44861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=42933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:44.842964 12196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:44.843129 12196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:44.852607 12206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:44.852777 12196 server_base.cc:1034] running on GCE node
W20260812 01:16:44.852607 12209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:44.852638 12213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:44.853178 12196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:44.853492 12196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:44.854661 12196 hybrid_clock.cc:648] HybridClock initialized: now 1786497404854649 us; error 52 us; skew 500 ppm
Aug 12 01:16:44 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497404, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:44.857227 12196 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:16:44.857707 12196 webserver.cc:460] Webserver started at http://127.17.183.190:42933/ using document root <none> and password file <none>
I20260812 01:16:44.857937 12196 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:44.858018 12196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:44.859819 12196 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:44.860559 12223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:44.860736 12196 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:44.860837 12196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "f334583d763d4d569185ad9c00694e19"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "7974417d770dfb8cba8b012de96c36db"
server_key_iv: "58938957a378a8645698adb8300eb617"
server_key_version: "encryptionkey@0"
I20260812 01:16:44.861236 12196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:44.885039 12196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:44.886983 12196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:44.887166 12196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:44.891390 12196 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:44861
I20260812 01:16:44.891424 12315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:44861 every 8 connection(s)
I20260812 01:16:44.891817 12196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:16:44.893030 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 12196
I20260812 01:16:44.893354 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:45573
--local_ip_for_outbound_sockets=127.17.183.129
--tserver_master_addrs=127.17.183.190:44861
--webserver_port=34571
--webserver_interface=127.17.183.129
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:16:44.893702 12316 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:16:44.894412 12316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Bootstrap starting.
I20260812 01:16:44.903920 12316 log.cc:824] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:44.906003 12316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:16:44.906335 12316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Bootstrap complete.
I20260812 01:16:44.908766 12316 raft_consensus.cc:348] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:44.909021 12316 raft_consensus.cc:729] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f334583d763d4d569185ad9c00694e19, State: Initialized, Role: FOLLOWER
I20260812 01:16:44.909212 12316 consensus_queue.cc:260] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:44.909315 12316 raft_consensus.cc:388] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:16:44.909375 12316 raft_consensus.cc:482] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:16:44.909425 12316 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:16:44.910429 12316 raft_consensus.cc:504] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:44.910562 12316 leader_election.cc:302] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f334583d763d4d569185ad9c00694e19; no voters:
I20260812 01:16:44.910760 12316 leader_election.cc:288] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 01:16:44.910799 12329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 01:16:44.910910 12329 raft_consensus.cc:686] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 2 LEADER]: Becoming Leader. State: Replica: f334583d763d4d569185ad9c00694e19, State: Running, Role: LEADER
I20260812 01:16:44.911031 12316 sys_catalog.cc:564] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:16:44.911101 12329 consensus_queue.cc:237] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:44.911372 12332 sys_catalog.cc:455] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f334583d763d4d569185ad9c00694e19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } } }
I20260812 01:16:44.911566 12332 sys_catalog.cc:458] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:44.911367 12329 sys_catalog.cc:455] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f334583d763d4d569185ad9c00694e19. Latest consensus state: current_term: 2 leader_uuid: "f334583d763d4d569185ad9c00694e19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } } }
I20260812 01:16:44.912029 12329 sys_catalog.cc:458] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:44.912210 12342 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:16:44.913261 12342 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:16:44.913381 12342 catalog_manager.cc:1259] Loaded cluster ID: 73eeeba4af0042f3ba25b79829cbeecf
I20260812 01:16:44.913415 12342 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:16:44.913686 12342 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 01:16:44.918413 12342 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 01:16:44.920890 12342 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:16:44.921090 12342 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Loaded TSK: 0
I20260812 01:16:44.921310 12342 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 01:16:44.981065 12322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:44.981340 12322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:44.981388 12322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:44.982712 12322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:44.982793 12322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:44.982848 12322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:16:44.984634 12322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:45573
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=34571
--tserver_master_addrs=127.17.183.190:44861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:44.984927 12322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:44.985211 12322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:44.992323 12369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:44.992300 12371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:44.992322 12373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:44.992727 12322 server_base.cc:1034] running on GCE node
I20260812 01:16:44.992992 12322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:44.993283 12322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:44.994460 12322 hybrid_clock.cc:648] HybridClock initialized: now 1786497404994430 us; error 42 us; skew 500 ppm
Aug 12 01:16:44 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497404, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:44.997362 12322 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:16:44.997882 12322 webserver.cc:460] Webserver started at http://127.17.183.129:34571/ using document root <none> and password file <none>
I20260812 01:16:44.998083 12322 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:44.998137 12322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:44.999578 12322 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:16:45.000322 12387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:45.000581 12322 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:16:45.000687 12322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "2cf9627e384e44cfb133df7fc308abc2"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "979486a002d462e85364721d4736b051"
server_key_iv: "2929fd50980f75d18548a93ef635890c"
server_key_version: "encryptionkey@0"
I20260812 01:16:45.001065 12322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:45.010236 12322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:45.012730 12322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:45.012900 12322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:45.013167 12322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:45.013685 12397 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 01:16:45.015146 12322 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 01:16:45.015195 12322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 01:16:45.015229 12322 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 01:16:45.015924 12322 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 01:16:45.015969 12322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 01:16:45.016016 12397 tablet_bootstrap.cc:492] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Bootstrap starting.
I20260812 01:16:45.024276 12322 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:45573
I20260812 01:16:45.024463 12603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:45573 every 8 connection(s)
I20260812 01:16:45.024852 12322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:16:45.028836 12397 log.cc:824] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:45.029469 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 12322
I20260812 01:16:45.029816 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:37021
--local_ip_for_outbound_sockets=127.17.183.130
--tserver_master_addrs=127.17.183.190:44861
--webserver_port=41285
--webserver_interface=127.17.183.130
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:16:45 dist-test-slave-rwrg krb5kdc[11173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497404, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:45.036151 12397 tablet_bootstrap.cc:492] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:16:45.036549 12397 tablet_bootstrap.cc:492] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Bootstrap complete.
I20260812 01:16:45.038250 12397 ts_tablet_manager.cc:1397] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.007s
I20260812 01:16:45.039788 12397 raft_consensus.cc:348] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.040150 12397 raft_consensus.cc:729] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cf9627e384e44cfb133df7fc308abc2, State: Initialized, Role: FOLLOWER
I20260812 01:16:45.040337 12397 consensus_queue.cc:260] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.040656 12397 ts_tablet_manager.cc:1428] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Time spent starting tablet: real 0.002s user 0.002s sys 0.002s
I20260812 01:16:45.041047 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.025758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:41151)
0812 01:16:45.025977 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:45.026032 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:45.026648 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:45.029191 (+ 2543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:45.029196 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:45.029628 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:45.029930 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.029939 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.031673 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.031675 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.032631 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.032634 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.033561 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.033563 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.033698 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.034312 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:45.034322 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:45.035985 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:45.038975 (+ 2990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:45.038983 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:45.038986 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:45.039277 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:45.039588 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:45.039589 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:45.039589 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:45.039715 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:45.040283 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:45.040326 (+ 43us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:45.040593 (+ 267us) client_negotiation.cc:769] Sending connection context
0812 01:16:45.040687 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 01:16:45.040905 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":110,"threads_started":1}
I20260812 01:16:45.041769 12608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.025880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:41151 (local address 127.17.183.190:44861)
0812 01:16:45.028701 (+ 2821us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:45.028712 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:45.028771 (+ 59us) server_negotiation.cc:407] Connection header received
0812 01:16:45.028921 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:45.028929 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:45.028994 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:45.029156 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:45.030101 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.031516 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.032721 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.033316 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.033433 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.036128 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:45.036133 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:45.036133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:45.036146 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:45.038867 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:45.039376 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:45.039379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:45.039380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:45.039495 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:45.039790 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:45.039791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:45.039792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:45.040080 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:45.041321 (+ 1241us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:45.041395 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 01:16:45.041538 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2756,"thread_start_us":74,"threads_started":1}
I20260812 01:16:45.042440 12604 heartbeater.cc:347] Connected to a master server at 127.17.183.190:44861
I20260812 01:16:45.042547 12604 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:45.042721 12604 heartbeater.cc:511] Master 127.17.183.190:44861 requested a full tablet report, sending...
I20260812 01:16:45.043496 12253 ts_manager.cc:194] Registered new tserver with Master: 2cf9627e384e44cfb133df7fc308abc2 (127.17.183.129:45573)
I20260812 01:16:45.044742 12253 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:41151
I20260812 01:16:45.045852 12604 heartbeater.cc:503] Master 127.17.183.190:44861 was elected leader, sending a full tablet report...
Aug 12 01:16:45 dist-test-slave-rwrg krb5kdc[11173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497404, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:16:45.052973 12612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.044146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45573 (local address 127.0.0.1:43236)
0812 01:16:45.044598 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:45.044634 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:45.044696 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:45.045148 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:45.045152 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:45.045446 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:45.045493 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.045495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.046646 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.046647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.047242 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.047244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.047747 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.047748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.047842 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.048338 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:45.048342 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:45.049830 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:45.051679 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:45.051687 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:45.051689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:45.051891 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:45.052157 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:45.052158 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:45.052159 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:45.052223 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:45.052536 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:45.052544 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:45.052635 (+ 91us) client_negotiation.cc:769] Sending connection context
0812 01:16:45.052751 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 01:16:45.052877 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":94,"threads_started":1}
I20260812 01:16:45.052975 12614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.044386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43236 (local address 127.17.183.129:45573)
0812 01:16:45.044892 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:45.044897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:45.044907 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:16:45.044941 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:45.044942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:45.044956 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:45.045566 (+ 610us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:45.045696 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.046563 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.047338 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.047652 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.047743 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.049923 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:45.049932 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:45.049932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:45.049939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:45.051569 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:45.052006 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:45.052009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:45.052009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:45.052071 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:45.052288 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:45.052289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:45.052289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:45.052424 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:45.052545 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:45.052793 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 01:16:45.052876 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":62,"threads_started":1}
I20260812 01:16:45.053781 12470 tablet_service.cc:1514] Processing DeleteTablet for tablet dc53f476258249b2b7801cbb50c6c769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:16:44 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:43236
I20260812 01:16:45.054302 12617 tablet_replica.cc:330] stopping tablet replica
I20260812 01:16:45.054430 12617 raft_consensus.cc:2229] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:16:45.054505 12617 raft_consensus.cc:2258] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:16:45.054829 12617 ts_tablet_manager.cc:1905] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:16:45.056744 12617 ts_tablet_manager.cc:1918] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:16:45.056846 12617 log.cc:1196] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/dc53f476258249b2b7801cbb50c6c769
I20260812 01:16:45.057071 12617 ts_tablet_manager.cc:1939] T dc53f476258249b2b7801cbb50c6c769 P 2cf9627e384e44cfb133df7fc308abc2: Deleting consensus metadata
I20260812 01:16:45.057582 12233 catalog_manager.cc:4841] TS 2cf9627e384e44cfb133df7fc308abc2 (127.17.183.129:45573): tablet dc53f476258249b2b7801cbb50c6c769 (table test-table [id=b4dc2b7bb3fa43d98551673edaa66bdc]) successfully deleted
W20260812 01:16:45.126176 12610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:45.126381 12610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:45.126405 12610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:45.127612 12610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:45.127651 12610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:45.127677 12610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:16:45.129226 12610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:37021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=41285
--tserver_master_addrs=127.17.183.190:44861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:45.129496 12610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:45.129761 12610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:45.134910 12627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:45.134974 12623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:45.134912 12624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:45.135269 12610 server_base.cc:1034] running on GCE node
I20260812 01:16:45.135509 12610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:45.135754 12610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:45.136916 12610 hybrid_clock.cc:648] HybridClock initialized: now 1786497405136912 us; error 38 us; skew 500 ppm
Aug 12 01:16:45 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497405, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:45.139588 12610 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:16:45.140048 12610 webserver.cc:460] Webserver started at http://127.17.183.130:41285/ using document root <none> and password file <none>
I20260812 01:16:45.140308 12610 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:45.140388 12610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:45.141785 12610 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:45.142382 12637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:45.142586 12610 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:16:45.142699 12610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "70c9e6ceb12c4e4bb787156bbe052e98"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "74c1bdedd1a09f2be2583ae7a65f6369"
server_key_iv: "7e0d67dca2ab98d2334dc53738828342"
server_key_version: "encryptionkey@0"
I20260812 01:16:45.143035 12610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:45.157454 12610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:45.159901 12610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:45.160072 12610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:45.160322 12610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:45.160669 12610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:45.160727 12610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:45.160761 12610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:45.160791 12610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:45.167133 12610 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:37021
I20260812 01:16:45.167191 12861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:37021 every 8 connection(s)
I20260812 01:16:45.167527 12610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
Aug 12 01:16:45 dist-test-slave-rwrg krb5kdc[11173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497405, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:45.176582 12608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.168208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:38477 (local address 127.17.183.190:44861)
0812 01:16:45.168267 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:45.168269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:45.168471 (+ 202us) server_negotiation.cc:407] Connection header received
0812 01:16:45.169044 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:45.169045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:45.169058 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:45.169113 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:45.170033 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.170540 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.171486 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.171678 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.171729 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.173810 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:45.173811 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:45.173811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:45.173818 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:45.175376 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:45.175716 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:45.175717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:45.175717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:45.175767 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:45.175972 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:45.175973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:45.175973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:45.176074 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:45.176137 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:45.176380 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 01:16:45.176448 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 01:16:45.176746 12868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.168199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:38477)
0812 01:16:45.168347 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:45.168384 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:45.168931 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:45.169168 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:45.169171 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:45.169759 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:45.169946 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.169951 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.170643 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.170644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.171411 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.171413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.171755 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.171755 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.171859 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.172307 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:45.172314 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:45.173720 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:45.175447 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:45.175452 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:45.175454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:45.175651 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:45.175824 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:45.175825 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:45.175825 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:45.175917 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:45.176142 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:45.176146 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:45.176271 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 01:16:45.176351 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 01:16:45.176466 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260812 01:16:45.177151 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 12610
I20260812 01:16:45.177314 12863 heartbeater.cc:347] Connected to a master server at 127.17.183.190:44861
I20260812 01:16:45.177420 12863 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:45.177495 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:35787
--local_ip_for_outbound_sockets=127.17.183.131
--tserver_master_addrs=127.17.183.190:44861
--webserver_port=33507
--webserver_interface=127.17.183.131
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:16:45.177619 12863 heartbeater.cc:511] Master 127.17.183.190:44861 requested a full tablet report, sending...
I20260812 01:16:45.178009 12253 ts_manager.cc:194] Registered new tserver with Master: 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021)
I20260812 01:16:45.178411 12253 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:38477
W20260812 01:16:45.261624 12872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:45.261874 12872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:45.261898 12872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:45.262987 12872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:45.263023 12872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:45.263049 12872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:16:45.264691 12872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:35787
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=33507
--tserver_master_addrs=127.17.183.190:44861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:45.264920 12872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:45.265151 12872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:45.270205 12881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:45.270193 12888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:45.270416 12872 server_base.cc:1034] running on GCE node
W20260812 01:16:45.270195 12883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:45.270668 12872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:45.270910 12872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:45.272073 12872 hybrid_clock.cc:648] HybridClock initialized: now 1786497405272066 us; error 37 us; skew 500 ppm
Aug 12 01:16:45 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497405, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:45.274624 12872 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:16:45.275086 12872 webserver.cc:460] Webserver started at http://127.17.183.131:33507/ using document root <none> and password file <none>
I20260812 01:16:45.275314 12872 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:45.275393 12872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:45.276783 12872 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:16:45.277377 12896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:45.277562 12872 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:45.277673 12872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "a98291b969c94fa8b5b2e981dc5ad61c"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "ba430952066266df6a8b0f91bb31326a"
server_key_iv: "9ab4b16e95342496e51589fd1d44add3"
server_key_version: "encryptionkey@0"
I20260812 01:16:45.278020 12872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:45.294936 12872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:45.297089 12872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:45.297264 12872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:45.297515 12872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:45.297848 12872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:45.297905 12872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:45.297945 12872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:45.297989 12872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:45.304376 12872 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:35787
I20260812 01:16:45.304436 13124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:35787 every 8 connection(s)
I20260812 01:16:45.304811 12872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
Aug 12 01:16:45 dist-test-slave-rwrg krb5kdc[11173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497405, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:16:45.315809 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 12872
I20260812 01:16:45.320273 12608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.305838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:36113 (local address 127.17.183.190:44861)
0812 01:16:45.305895 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:45.305897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:45.306186 (+ 289us) server_negotiation.cc:407] Connection header received
0812 01:16:45.307035 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:45.307037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:45.307051 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:45.307096 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:45.308131 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.308798 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.310469 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.310816 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.310947 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.314000 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:45.314002 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:45.314002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:45.314011 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:45.318717 (+ 4706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:45.319141 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:45.319142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:45.319142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:45.319206 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:45.319532 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:45.319533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:45.319533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:45.319690 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:45.319751 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:45.320084 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 01:16:45.320172 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 01:16:45.320441 13130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.305833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:36113)
0812 01:16:45.306013 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:45.306069 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:45.306902 (+ 833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:45.307177 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:45.307181 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:45.307780 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:45.308025 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.308030 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.308901 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.308902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.310346 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.310350 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.311024 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.311025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.311173 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.311798 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:45.311808 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:45.313867 (+ 2059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:45.318789 (+ 4922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:45.318798 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:45.318800 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:45.319034 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:45.319289 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:45.319290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:45.319290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:45.319428 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:45.319756 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:45.319764 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:45.319927 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 01:16:45.320036 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 01:16:45.320198 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":88,"threads_started":1}
I20260812 01:16:45.320914 13126 heartbeater.cc:347] Connected to a master server at 127.17.183.190:44861
I20260812 01:16:45.321012 13126 heartbeater.cc:464] Registering TS with master...
I20260812 01:16:45.321223 13126 heartbeater.cc:511] Master 127.17.183.190:44861 requested a full tablet report, sending...
I20260812 01:16:45.321633 12253 ts_manager.cc:194] Registered new tserver with Master: a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787)
I20260812 01:16:45.322118 12253 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:36113
I20260812 01:16:45.325346 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.317902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58224 (local address 127.17.183.190:44861)
0812 01:16:45.318028 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:45.318030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:45.318038 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:16:45.318059 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:45.318060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:45.318072 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:45.318134 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:45.318720 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.319515 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.321362 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.321549 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.321644 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.322896 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:45.322897 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:45.322898 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:45.322905 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:45.324135 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:45.324528 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:45.324529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:45.324529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:45.324586 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:45.324821 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:45.324822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:45.324823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:45.324934 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:45.325114 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:45.325150 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 01:16:45.325225 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":60,"threads_started":1}
I20260812 01:16:45.326156 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:16:45.328668 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.326499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58240 (local address 127.17.183.190:44861)
0812 01:16:45.326530 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:45.326531 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:45.326647 (+ 116us) server_negotiation.cc:407] Connection header received
0812 01:16:45.326695 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:45.326696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:45.326729 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:45.326788 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:16:45.326857 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.327298 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.327993 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.328170 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.328221 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.328345 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:16:45.328428 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:16:45.328481 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:45.328600 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 01:16:45.328625 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 01:16:45.328940 12253 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:58240:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:16:45.330516 12253 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:16:45.332547 12470 tablet_service.cc:1467] Processing CreateTablet for tablet ea88ecfc27d44d109f72ebaccdedabd0 (DEFAULT_TABLE table=test-table [id=7a09a332cac249c09abf26c62031b4c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:16:45.332765 12470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea88ecfc27d44d109f72ebaccdedabd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:45.334441 12397 tablet_bootstrap.cc:492] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2: Bootstrap starting.
I20260812 01:16:45.334787 12397 tablet_bootstrap.cc:654] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:45.335424 12397 tablet_bootstrap.cc:492] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2: No bootstrap required, opened a new log
I20260812 01:16:45.335492 12397 ts_tablet_manager.cc:1397] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 01:16:45.335855 12397 raft_consensus.cc:348] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.335939 12397 raft_consensus.cc:374] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:45.335981 12397 raft_consensus.cc:729] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cf9627e384e44cfb133df7fc308abc2, State: Initialized, Role: FOLLOWER
I20260812 01:16:45.336030 12397 consensus_queue.cc:260] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.336115 12397 ts_tablet_manager.cc:1428] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 01:16:45.336596 13135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.332381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:37021 (local address 127.0.0.1:35006)
0812 01:16:45.332580 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:45.332592 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:45.332647 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:45.333012 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:45.333013 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:45.333015 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:45.333054 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.333056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.334364 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.334365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.335456 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.335495 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.336308 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.336309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.336368 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.336390 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 01:16:45.336449 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 01:16:45.336521 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":3,"thread_start_us":125,"threads_started":1}
I20260812 01:16:45.336603 13139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.332645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35006 (local address 127.17.183.130:37021)
0812 01:16:45.332832 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:45.332837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:45.332848 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:16:45.332886 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:45.332889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:45.332905 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:45.333124 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:45.333190 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.334212 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.335593 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.336201 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.336307 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.336365 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:45.336465 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 01:16:45.336525 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
I20260812 01:16:45.336710 12612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.332286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:35787 (local address 127.0.0.1:52860)
0812 01:16:45.332320 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:45.332330 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:45.332364 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:45.332855 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:45.332856 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:45.332858 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:45.332898 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.332899 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.334288 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.334289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.335498 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.335501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.336433 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.336434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.336551 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.336554 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:16:45.336590 (+ 36us) client_negotiation.cc:240] Negotiation successful
0812 01:16:45.336640 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17,"mutex_wait_us":54}
I20260812 01:16:45.336998 13137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.332459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52860 (local address 127.17.183.131:35787)
0812 01:16:45.332656 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:45.332661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:45.332671 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:16:45.332712 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:45.332714 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:45.332731 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:45.332974 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:45.333027 (+ 53us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.334185 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.335606 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.336343 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.336796 (+ 453us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.336840 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:45.336861 (+ 21us) server_negotiation.cc:299] Negotiation successful
0812 01:16:45.336891 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":96,"threads_started":1}
I20260812 01:16:45.337767 12730 tablet_service.cc:1467] Processing CreateTablet for tablet ea88ecfc27d44d109f72ebaccdedabd0 (DEFAULT_TABLE table=test-table [id=7a09a332cac249c09abf26c62031b4c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:16:45.337764 12996 tablet_service.cc:1467] Processing CreateTablet for tablet ea88ecfc27d44d109f72ebaccdedabd0 (DEFAULT_TABLE table=test-table [id=7a09a332cac249c09abf26c62031b4c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:16:45.338130 12730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea88ecfc27d44d109f72ebaccdedabd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:45.338130 12996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea88ecfc27d44d109f72ebaccdedabd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:16:45.341776 13145 tablet_bootstrap.cc:492] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c: Bootstrap starting.
I20260812 01:16:45.342514 13145 tablet_bootstrap.cc:654] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:45.343008 13145 log.cc:824] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:45.343367 13144 tablet_bootstrap.cc:492] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: Bootstrap starting.
I20260812 01:16:45.343794 13145 tablet_bootstrap.cc:492] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c: No bootstrap required, opened a new log
I20260812 01:16:45.343852 13145 ts_tablet_manager.cc:1397] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:16:45.343950 13144 tablet_bootstrap.cc:654] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: Neither blocks nor log segments found. Creating new log.
I20260812 01:16:45.344455 13144 log.cc:824] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:45.345181 13144 tablet_bootstrap.cc:492] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: No bootstrap required, opened a new log
I20260812 01:16:45.345274 13144 ts_tablet_manager.cc:1397] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 01:16:45.345572 13145 raft_consensus.cc:348] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.345733 13145 raft_consensus.cc:374] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:45.345794 13145 raft_consensus.cc:729] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a98291b969c94fa8b5b2e981dc5ad61c, State: Initialized, Role: FOLLOWER
I20260812 01:16:45.345919 13145 consensus_queue.cc:260] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.346202 13145 ts_tablet_manager.cc:1428] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 01:16:45.346233 13126 heartbeater.cc:503] Master 127.17.183.190:44861 was elected leader, sending a full tablet report...
I20260812 01:16:45.347361 13144 raft_consensus.cc:348] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.347517 13144 raft_consensus.cc:374] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:16:45.347563 13144 raft_consensus.cc:729] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c9e6ceb12c4e4bb787156bbe052e98, State: Initialized, Role: FOLLOWER
I20260812 01:16:45.347671 13144 consensus_queue.cc:260] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.347949 13144 ts_tablet_manager.cc:1428] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:16:45.347977 12863 heartbeater.cc:503] Master 127.17.183.190:44861 was elected leader, sending a full tablet report...
W20260812 01:16:45.418138 12864 tablet.cc:2369] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:16:45.496765 13152 raft_consensus.cc:482] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:16:45.496959 13152 raft_consensus.cc:504] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.497404 13152 leader_election.cc:288] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021), 2cf9627e384e44cfb133df7fc308abc2 (127.17.183.129:45573)
I20260812 01:16:45.500615 13130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.497609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:37021 (local address 127.17.183.131:35711)
0812 01:16:45.497671 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:45.497683 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:45.497731 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:45.497912 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:45.497913 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:45.497915 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:45.497997 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.497999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.498739 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.498740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.499542 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.499545 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.500330 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.500332 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.500420 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.500424 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:16:45.500473 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 01:16:45.500538 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":19}
I20260812 01:16:45.500663 13139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.497698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:35711 (local address 127.17.183.130:37021)
0812 01:16:45.497761 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:45.497763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:45.497772 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:16:45.497808 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:45.497809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:45.497818 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:45.497889 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:45.498081 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.498653 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.499654 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.500213 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.500286 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.500296 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:45.500527 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 01:16:45.500563 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 01:16:45.501159 12769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea88ecfc27d44d109f72ebaccdedabd0" candidate_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" is_pre_election: true
I20260812 01:16:45.501264 12614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.497646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:40919 (local address 127.17.183.129:45573)
0812 01:16:45.497688 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:45.497691 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:45.497894 (+ 203us) server_negotiation.cc:407] Connection header received
0812 01:16:45.497927 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:45.497928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:45.497957 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:45.498035 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:16:45.498245 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.498785 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.499837 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.500558 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.500638 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.500733 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:45.501171 (+ 438us) server_negotiation.cc:299] Negotiation successful
0812 01:16:45.501215 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:16:45.501268 13158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.497613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45573 (local address 127.17.183.131:40919)
0812 01:16:45.497814 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:45.497824 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:45.497881 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:45.498075 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:45.498076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:45.498078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:16:45.498165 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.498167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.498874 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.498875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.499713 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:45.499716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.501000 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.501002 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:45.501081 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.501085 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:16:45.501152 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 01:16:45.501193 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":14,"thread_start_us":115,"threads_started":1}
I20260812 01:16:45.501358 12769 raft_consensus.cc:2454] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a98291b969c94fa8b5b2e981dc5ad61c in term 0.
I20260812 01:16:45.501586 12901 leader_election.cc:302] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c9e6ceb12c4e4bb787156bbe052e98, a98291b969c94fa8b5b2e981dc5ad61c; no voters:
I20260812 01:16:45.501748 13152 raft_consensus.cc:2781] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:16:45.501816 13152 raft_consensus.cc:482] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:16:45.501752 12516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea88ecfc27d44d109f72ebaccdedabd0" candidate_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cf9627e384e44cfb133df7fc308abc2" is_pre_election: true
I20260812 01:16:45.501852 13152 raft_consensus.cc:3037] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:45.501933 12516 raft_consensus.cc:2454] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a98291b969c94fa8b5b2e981dc5ad61c in term 0.
I20260812 01:16:45.502710 13152 raft_consensus.cc:504] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.502863 13152 leader_election.cc:288] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [CANDIDATE]: Term 1 election: Requested vote from peers 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021), 2cf9627e384e44cfb133df7fc308abc2 (127.17.183.129:45573)
I20260812 01:16:45.503037 12769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea88ecfc27d44d109f72ebaccdedabd0" candidate_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c9e6ceb12c4e4bb787156bbe052e98"
I20260812 01:16:45.503037 12516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea88ecfc27d44d109f72ebaccdedabd0" candidate_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cf9627e384e44cfb133df7fc308abc2"
I20260812 01:16:45.503124 12769 raft_consensus.cc:3037] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:45.503150 12516 raft_consensus.cc:3037] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:16:45.503898 12516 raft_consensus.cc:2454] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a98291b969c94fa8b5b2e981dc5ad61c in term 1.
I20260812 01:16:45.504009 12769 raft_consensus.cc:2454] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a98291b969c94fa8b5b2e981dc5ad61c in term 1.
I20260812 01:16:45.504150 12907 leader_election.cc:302] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cf9627e384e44cfb133df7fc308abc2, a98291b969c94fa8b5b2e981dc5ad61c; no voters:
I20260812 01:16:45.504268 13152 raft_consensus.cc:2781] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:16:45.504419 13152 raft_consensus.cc:686] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 1 LEADER]: Becoming Leader. State: Replica: a98291b969c94fa8b5b2e981dc5ad61c, State: Running, Role: LEADER
I20260812 01:16:45.504560 13152 consensus_queue.cc:237] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.505523 12253 catalog_manager.cc:5495] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c reported cstate change: term changed from 0 to 1, leader changed from <none> to a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131). New cstate: current_term: 1 leader_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } health_report { overall_health: UNKNOWN } } }
I20260812 01:16:45.518344 13137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.516157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52864 (local address 127.17.183.131:35787)
0812 01:16:45.516202 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:45.516204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:45.516215 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:16:45.516295 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:45.516296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:45.516312 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:45.516375 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:16:45.516506 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.516954 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.517679 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:45.517866 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:45.517919 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:45.518070 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:16:45.518162 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:16:45.518221 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:45.518254 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 01:16:45.518270 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 01:16:45.520138 12516 raft_consensus.cc:1261] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Refusing update from remote peer a98291b969c94fa8b5b2e981dc5ad61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:16:45.520440 12769 raft_consensus.cc:1261] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 1 FOLLOWER]: Refusing update from remote peer a98291b969c94fa8b5b2e981dc5ad61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:16:45.520522 13159 consensus_queue.cc:1035] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:16:45.520779 13159 consensus_queue.cc:1035] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:16:45.522864 13165 mvcc.cc:205] Tried to move back new op lower bound from 7317493373007876096 to 7317493372947660800. Current Snapshot: MvccSnapshot[applied={T|T < 7317493373007876096 or (T in {7317493373007876096})}]
I20260812 01:16:45.523139 13166 mvcc.cc:205] Tried to move back new op lower bound from 7317493373007876096 to 7317493372947660800. Current Snapshot: MvccSnapshot[applied={T|T < 7317493373007876096}]
I20260812 01:16:45.524801 12253 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:58240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:16:45.524902 12253 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:58240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:16:45.525710 12253 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Sending DeleteTablet for 3 replicas of tablet ea88ecfc27d44d109f72ebaccdedabd0
I20260812 01:16:45.526055 12730 tablet_service.cc:1514] Processing DeleteTablet for tablet ea88ecfc27d44d109f72ebaccdedabd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:16:45 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:35006
I20260812 01:16:45.526190 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 12322
I20260812 01:16:45.526229 12996 tablet_service.cc:1514] Processing DeleteTablet for tablet ea88ecfc27d44d109f72ebaccdedabd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:16:45 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:52860
I20260812 01:16:45.526364 13182 tablet_replica.cc:330] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: stopping tablet replica
I20260812 01:16:45.561786 13182 raft_consensus.cc:2229] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:16:45.562059 13182 raft_consensus.cc:2258] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:16:45.563396 12730 tablet_service.cc:1514] Processing DeleteTablet for tablet ea88ecfc27d44d109f72ebaccdedabd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:16:45 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:35006
I20260812 01:16:45.563442 13182 ts_tablet_manager.cc:1905] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:16:45.564689 13183 tablet_replica.cc:330] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c: stopping tablet replica
I20260812 01:16:45.564921 13183 raft_consensus.cc:2229] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:16:45.565124 13183 raft_consensus.cc:2258] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:16:45.565631 13183 ts_tablet_manager.cc:1905] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:16:45.565786 13182 ts_tablet_manager.cc:1918] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:16:45.565876 13182 log.cc:1196] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/ea88ecfc27d44d109f72ebaccdedabd0
I20260812 01:16:45.566188 13182 ts_tablet_manager.cc:1939] T ea88ecfc27d44d109f72ebaccdedabd0 P 70c9e6ceb12c4e4bb787156bbe052e98: Deleting consensus metadata
I20260812 01:16:45.566704 12226 catalog_manager.cc:4841] TS 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021): tablet ea88ecfc27d44d109f72ebaccdedabd0 (table test-table [id=7a09a332cac249c09abf26c62031b4c5]) successfully deleted
W20260812 01:16:45.567083 12226 catalog_manager.cc:4808] TS 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021): delete failed for tablet ea88ecfc27d44d109f72ebaccdedabd0 because the tablet was not found. No further retry: Not found: Tablet not found: ea88ecfc27d44d109f72ebaccdedabd0
I20260812 01:16:45.567822 13183 ts_tablet_manager.cc:1918] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:16:45.567909 13183 log.cc:1196] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/ea88ecfc27d44d109f72ebaccdedabd0
I20260812 01:16:45.568209 13183 ts_tablet_manager.cc:1939] T ea88ecfc27d44d109f72ebaccdedabd0 P a98291b969c94fa8b5b2e981dc5ad61c: Deleting consensus metadata
I20260812 01:16:45.568670 12226 catalog_manager.cc:4841] TS a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787): tablet ea88ecfc27d44d109f72ebaccdedabd0 (table test-table [id=7a09a332cac249c09abf26c62031b4c5]) successfully deleted
W20260812 01:16:45.569423 12233 connection.cc:535] client connection to 127.17.183.129:45573 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:16:45.569545 12233 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 01:16:45.569821 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 12610
I20260812 01:16:45.584790 13135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:45.570015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:45573 (local address 127.0.0.1:43248)
0812 01:16:45.584686 (+ 14671us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:45.584752 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:45573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14630}
W20260812 01:16:45.584957 12233 catalog_manager.cc:4584] TS 2cf9627e384e44cfb133df7fc308abc2 (127.17.183.129:45573): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ea88ecfc27d44d109f72ebaccdedabd0: Network error: Client connection negotiation failed: client connection to 127.17.183.129:45573: connect: Connection refused (error 111)
I20260812 01:16:45.589134 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 12872
I20260812 01:16:45.600082 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 12196
I20260812 01:16:45.613268 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44861
--webserver_interface=127.17.183.190
--webserver_port=42933
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:44861
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:45.695601 13188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:45.695829 13188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:45.695863 13188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:45.697043 13188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:16:45.697109 13188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:45.697134 13188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:45.697155 13188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:16:45.697183 13188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:16:45.698650 13188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:44861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:44861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=42933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:45.698916 13188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:45.699155 13188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:45.703995 13197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:45.704013 13196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:45.704001 13201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:45.704249 13188 server_base.cc:1034] running on GCE node
I20260812 01:16:45.704548 13188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:45.704918 13188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:45.706096 13188 hybrid_clock.cc:648] HybridClock initialized: now 1786497405706078 us; error 35 us; skew 500 ppm
Aug 12 01:16:45 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497405, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:45.709915 13188 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:16:45.710413 13188 webserver.cc:460] Webserver started at http://127.17.183.190:42933/ using document root <none> and password file <none>
I20260812 01:16:45.710757 13188 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:45.710826 13188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:45.712330 13188 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 01:16:45.713088 13209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:45.713285 13188 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 01:16:45.713394 13188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "f334583d763d4d569185ad9c00694e19"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "7974417d770dfb8cba8b012de96c36db"
server_key_iv: "58938957a378a8645698adb8300eb617"
server_key_version: "encryptionkey@0"
I20260812 01:16:45.713790 13188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:45.723229 13188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:45.725070 13188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:45.725193 13188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:45.729146 13188 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:44861
I20260812 01:16:45.729195 13303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:44861 every 8 connection(s)
I20260812 01:16:45.729597 13188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:16:45.731163 13306 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:16:45.731837 13306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Bootstrap starting.
I20260812 01:16:45.739061 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 13188
I20260812 01:16:45.739399 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:45573
--local_ip_for_outbound_sockets=127.17.183.129
--tserver_master_addrs=127.17.183.190:44861
--webserver_port=34571
--webserver_interface=127.17.183.129
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:16:45.741307 13306 log.cc:824] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:45.744374 13306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:16:45.744765 13306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19: Bootstrap complete.
I20260812 01:16:45.748813 13306 raft_consensus.cc:348] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:45.749194 13306 raft_consensus.cc:729] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f334583d763d4d569185ad9c00694e19, State: Initialized, Role: FOLLOWER
I20260812 01:16:45.749413 13306 consensus_queue.cc:260] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:45.749511 13306 raft_consensus.cc:388] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:16:45.749572 13306 raft_consensus.cc:482] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:16:45.749641 13306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 2 FOLLOWER]: Advancing to term 3
I20260812 01:16:45.751210 13306 raft_consensus.cc:504] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:45.751335 13306 leader_election.cc:302] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f334583d763d4d569185ad9c00694e19; no voters:
I20260812 01:16:45.751511 13306 leader_election.cc:288] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 01:16:45.751608 13311 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 01:16:45.751807 13306 sys_catalog.cc:564] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:16:45.751827 13311 raft_consensus.cc:686] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [term 3 LEADER]: Becoming Leader. State: Replica: f334583d763d4d569185ad9c00694e19, State: Running, Role: LEADER
I20260812 01:16:45.752018 13311 consensus_queue.cc:237] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } }
I20260812 01:16:45.752389 13314 sys_catalog.cc:455] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f334583d763d4d569185ad9c00694e19. Latest consensus state: current_term: 3 leader_uuid: "f334583d763d4d569185ad9c00694e19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } } }
I20260812 01:16:45.752384 13313 sys_catalog.cc:455] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f334583d763d4d569185ad9c00694e19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f334583d763d4d569185ad9c00694e19" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 44861 } } }
I20260812 01:16:45.752506 13314 sys_catalog.cc:458] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:45.752516 13313 sys_catalog.cc:458] T 00000000000000000000000000000000 P f334583d763d4d569185ad9c00694e19 [sys.catalog]: This master's current role is: LEADER
I20260812 01:16:45.753017 13331 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:16:45.753824 13331 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:16:45.753931 13331 catalog_manager.cc:1259] Loaded cluster ID: 73eeeba4af0042f3ba25b79829cbeecf
I20260812 01:16:45.753966 13331 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 01:16:45.754356 13331 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f93fe0549ad google::LogMessage::Fail() at ??:0
@ 0x7f93fe05788a google::LogMessage::SendToLog() at ??:0
@ 0x7f93fe0544de google::LogMessage::Flush() at ??:0
@ 0x7f93fe055a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9405f750f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f9405f7e8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f93fff220d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f93fff17954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9400d7b6db start_thread at ??:0
@ 0x7f93fcb5261f clone at ??:0
W20260812 01:16:45.833678 13309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:45.833901 13309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:45.833940 13309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:45.835047 13309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:45.835127 13309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:45.835168 13309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:16:45.836723 13309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:45573
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=34571
--tserver_master_addrs=127.17.183.190:44861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:45.836983 13309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:45.837219 13309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:45.842170 13375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:45.842242 13371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:45.842170 13370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:45.842525 13309 server_base.cc:1034] running on GCE node
I20260812 01:16:45.842723 13309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:45.842979 13309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:45.844134 13309 hybrid_clock.cc:648] HybridClock initialized: now 1786497405844118 us; error 33 us; skew 500 ppm
Aug 12 01:16:45 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497405, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:45.846822 13309 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:16:45.847298 13309 webserver.cc:460] Webserver started at http://127.17.183.129:34571/ using document root <none> and password file <none>
I20260812 01:16:45.847532 13309 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:45.847599 13309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:45.849004 13309 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:45.849735 13388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:45.850025 13309 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:45.850131 13309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "2cf9627e384e44cfb133df7fc308abc2"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "979486a002d462e85364721d4736b051"
server_key_iv: "2929fd50980f75d18548a93ef635890c"
server_key_version: "encryptionkey@0"
I20260812 01:16:45.850590 13309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:45.874846 13309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:45.877686 13309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:45.877861 13309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:45.878150 13309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:45.878731 13404 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 01:16:45.880244 13309 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 01:16:45.880317 13309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 01:16:45.880354 13309 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 01:16:45.881477 13309 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 01:16:45.881539 13309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 01:16:45.881626 13404 tablet_bootstrap.cc:492] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2: Bootstrap starting.
I20260812 01:16:45.889747 13309 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:45573
I20260812 01:16:45.889918 13608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:45573 every 8 connection(s)
I20260812 01:16:45.890288 13309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:16:45.892791 13404 log.cc:824] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2: Log is configured to *not* fsync() on all Append() calls
I20260812 01:16:45.894915 13404 tablet_bootstrap.cc:492] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:16:45.895190 13404 tablet_bootstrap.cc:492] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2: Bootstrap complete.
I20260812 01:16:45.896166 13404 ts_tablet_manager.cc:1397] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.004s
I20260812 01:16:45.896437 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 13309
I20260812 01:16:45.896716 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:37021
--local_ip_for_outbound_sockets=127.17.183.130
--tserver_master_addrs=127.17.183.190:44861
--webserver_port=41285
--webserver_interface=127.17.183.130
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:16:45.897927 13404 raft_consensus.cc:348] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.898308 13404 raft_consensus.cc:729] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cf9627e384e44cfb133df7fc308abc2, State: Initialized, Role: FOLLOWER
I20260812 01:16:45.898491 13404 consensus_queue.cc:260] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:45.898806 13404 ts_tablet_manager.cc:1428] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
W20260812 01:16:46.007176 13618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:46.007426 13618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:46.007468 13618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:46.008865 13618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:46.008914 13618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:46.008957 13618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:16:46.011507 13618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:37021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=41285
--tserver_master_addrs=127.17.183.190:44861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:46.011746 13618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:46.012028 13618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:46.017233 13615 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:16:45.891067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:59977)
0812 01:16:45.891325 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:45.891390 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:45.892141 (+ 751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:46.016916 (+124775us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":132,"threads_started":1}
W20260812 01:16:46.017541 13634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:46.017750 13640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:46.017748 13610 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:44861 (0 consecutive failures): Network error: Failed to ping master at 127.17.183.190:44861: Client connection negotiation failed: client connection to 127.17.183.190:44861: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:16:46.017903 13635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:46.018123 13615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:46.018014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:59225)
0812 01:16:46.018053 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:46.018094 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260812 01:16:46.018321 13618 server_base.cc:1034] running on GCE node
I20260812 01:16:46.018518 13615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:46.018418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:35005)
0812 01:16:46.018459 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:46.018492 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 01:16:46.018555 13618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20260812 01:16:46.018671 13610 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 01:16:46.018819 13618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:46.019953 13618 hybrid_clock.cc:648] HybridClock initialized: now 1786497406019939 us; error 22 us; skew 500 ppm
Aug 12 01:16:46 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497406, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:46.022543 13618 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:16:46.023021 13618 webserver.cc:460] Webserver started at http://127.17.183.130:41285/ using document root <none> and password file <none>
I20260812 01:16:46.023216 13618 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:46.023258 13618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:46.024659 13618 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:16:46.025235 13651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:46.025413 13618 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:16:46.025555 13618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "70c9e6ceb12c4e4bb787156bbe052e98"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "74c1bdedd1a09f2be2583ae7a65f6369"
server_key_iv: "7e0d67dca2ab98d2334dc53738828342"
server_key_version: "encryptionkey@0"
I20260812 01:16:46.025961 13618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:46.035267 13618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:46.037312 13618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:46.037483 13618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:46.037745 13618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:46.038079 13618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:46.038137 13618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:46.038182 13618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:46.038229 13618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:46.044723 13618 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:37021
I20260812 01:16:46.044778 13856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:37021 every 8 connection(s)
I20260812 01:16:46.045153 13618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:16:46.046244 13863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:46.045862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:33427)
0812 01:16:46.046023 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:46.046104 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
W20260812 01:16:46.046697 13858 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:44861 (0 consecutive failures): Network error: Failed to ping master at 127.17.183.190:44861: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
I20260812 01:16:46.046978 13863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:46.046890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:37837)
0812 01:16:46.046933 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:46.046960 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 01:16:46.047233 13863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:46.047176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:33195)
0812 01:16:46.047200 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:46.047220 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260812 01:16:46.047351 13858 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 01:16:46.053323 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 13618
I20260812 01:16:46.053584 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:35787
--local_ip_for_outbound_sockets=127.17.183.131
--tserver_master_addrs=127.17.183.190:44861
--webserver_port=33507
--webserver_interface=127.17.183.131
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:16:46.137182 13865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:16:46.137398 13865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:16:46.137420 13865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:16:46.138554 13865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:16:46.138605 13865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:16:46.138631 13865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:16:46.140184 13865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:35787
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=33507
--tserver_master_addrs=127.17.183.190:44861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:16:46.140446 13865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:16:46.140705 13865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:16:46.145838 13876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:16:46.145829 13878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:46.145890 13865 server_base.cc:1034] running on GCE node
W20260812 01:16:46.145852 13883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:16:46.146319 13865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:16:46.146551 13865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:16:46.147702 13865 hybrid_clock.cc:648] HybridClock initialized: now 1786497406147692 us; error 30 us; skew 500 ppm
Aug 12 01:16:46 dist-test-slave-rwrg krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497406, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:16:46.150413 13865 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:16:46.150914 13865 webserver.cc:460] Webserver started at http://127.17.183.131:33507/ using document root <none> and password file <none>
I20260812 01:16:46.151151 13865 fs_manager.cc:359] Metadata directory not provided
I20260812 01:16:46.151197 13865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:16:46.152684 13865 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:46.153327 13895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:46.153499 13865 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:16:46.153627 13865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "a98291b969c94fa8b5b2e981dc5ad61c"
format_stamp: "Formatted at 2026-08-12 01:16:44 on dist-test-slave-rwrg"
server_key: "ba430952066266df6a8b0f91bb31326a"
server_key_iv: "9ab4b16e95342496e51589fd1d44add3"
server_key_version: "encryptionkey@0"
I20260812 01:16:46.153990 13865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:16:46.179407 13865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:16:46.181903 13865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:16:46.182020 13865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:16:46.182206 13865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:16:46.182536 13865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:16:46.182571 13865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:46.182633 13865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:16:46.182660 13865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:16:46.188670 13865 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:35787
I20260812 01:16:46.188719 14130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:35787 every 8 connection(s)
I20260812 01:16:46.189062 13865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:16:46.189735 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 13865
I20260812 01:16:46.190157 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:46.189720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:46797)
0812 01:16:46.189906 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:46.190007 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":112,"threads_started":1}
W20260812 01:16:46.190586 14133 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:44861 (0 consecutive failures): Network error: Failed to ping master at 127.17.183.190:44861: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
I20260812 01:16:46.190900 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:46.190798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:50179)
0812 01:16:46.190850 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:46.190882 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 01:16:46.191211 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:46.191134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:42737)
0812 01:16:46.191175 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:46.191197 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 01:16:46.191344 14133 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 01:16:47.019404 14141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:47.019041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:52295)
0812 01:16:47.019272 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:47.019321 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":114,"threads_started":1}
I20260812 01:16:47.047953 14142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:47.047739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:59697)
0812 01:16:47.047866 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:47.047902 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
I20260812 01:16:47.191882 14143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:47.191648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:47003)
0812 01:16:47.191792 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:47.191827 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":75,"threads_started":1}
I20260812 01:16:47.347319 14144 raft_consensus.cc:482] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:16:47.347437 14144 raft_consensus.cc:504] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:47.347708 14144 leader_election.cc:288] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787), 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021)
Aug 12 01:16:47 dist-test-slave-rwrg krb5kdc[11173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497405, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.131@KRBTEST.COM
Aug 12 01:16:47 dist-test-slave-rwrg krb5kdc[11173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497405, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.130@KRBTEST.COM
I20260812 01:16:47.357996 14141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:47.347871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:35787 (local address 127.17.183.129:58895)
0812 01:16:47.347915 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:47.347926 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:47.347985 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:47.348995 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:47.348998 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:47.349426 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:47.349607 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:47.349613 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:47.350728 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:47.350729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:47.351466 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:47.351469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:47.352076 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:47.352077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:47.352189 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:47.352832 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:47.352840 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:47.354386 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:47.356484 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:47.356512 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:47.356514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:47.356729 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:47.356979 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:47.356980 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:47.356980 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:47.357089 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:47.357492 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:47.357498 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:47.357631 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 01:16:47.357730 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 01:16:47.357899 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":68}
I20260812 01:16:47.358011 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:47.347993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:58895 (local address 127.17.183.131:35787)
0812 01:16:47.348142 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:47.348161 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:47.348191 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:16:47.348746 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:47.348749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:47.348792 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:47.348908 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:47.349746 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:47.350607 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:47.351590 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:47.351982 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:47.352084 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:47.354492 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:47.354496 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:47.354497 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:47.354616 (+ 119us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:47.356398 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:47.356812 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:47.356815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:47.356816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:47.356901 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:47.357164 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:47.357164 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:47.357165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:47.357430 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:47.357499 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:47.357792 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 01:16:47.357913 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":62,"threads_started":1}
I20260812 01:16:47.358153 14145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:47.348003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:37021 (local address 127.17.183.129:46515)
0812 01:16:47.348119 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:47.348129 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:16:47.348174 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:16:47.349009 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:16:47.349010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:16:47.349428 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:16:47.349607 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:47.349613 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:47.350682 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:47.350684 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:47.351466 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:16:47.351468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:16:47.352115 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:16:47.352116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:16:47.352193 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:47.352892 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:16:47.352896 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:16:47.354799 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:16:47.356903 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:47.356904 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:47.356905 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:47.357085 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:47.357344 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:16:47.357345 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:16:47.357345 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:16:47.357401 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:16:47.357800 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:16:47.357801 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:16:47.357895 (+ 94us) client_negotiation.cc:769] Sending connection context
0812 01:16:47.357963 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 01:16:47.358058 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":3,"thread_start_us":54,"threads_started":1}
I20260812 01:16:47.358275 14150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:47.348121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:46515 (local address 127.17.183.130:37021)
0812 01:16:47.348281 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 01:16:47.348292 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:16:47.348328 (+ 36us) server_negotiation.cc:407] Connection header received
0812 01:16:47.348803 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:16:47.348805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:16:47.348841 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:16:47.349001 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:16:47.349747 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:47.350580 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:47.351621 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:16:47.351999 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:16:47.352129 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:16:47.354920 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:16:47.354923 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:16:47.354923 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:16:47.354935 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:16:47.356824 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:47.357185 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:47.357187 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:47.357188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:47.357278 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:16:47.357466 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:16:47.357467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:16:47.357468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:16:47.357712 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:16:47.357814 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 01:16:47.358039 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 01:16:47.358149 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":59,"threads_started":1}
W20260812 01:16:47.359009 13391 leader_election.cc:341] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021): Not found: Tablet not found: ea88ecfc27d44d109f72ebaccdedabd0
W20260812 01:16:47.359532 13391 leader_election.cc:341] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787): Not found: Tablet not found: ea88ecfc27d44d109f72ebaccdedabd0
I20260812 01:16:47.359619 13391 leader_election.cc:302] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cf9627e384e44cfb133df7fc308abc2; no voters: 70c9e6ceb12c4e4bb787156bbe052e98, a98291b969c94fa8b5b2e981dc5ad61c
I20260812 01:16:47.359743 14144 raft_consensus.cc:2726] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:16:48.020074 14152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:48.019855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:36829)
0812 01:16:48.019982 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:48.020022 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
I20260812 01:16:48.048628 14154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:48.048363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:38479)
0812 01:16:48.048542 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:48.048573 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":107,"threads_started":1}
I20260812 01:16:48.192591 14155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:48.192348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:57351)
0812 01:16:48.192471 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:48.192554 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":87,"threads_started":1}
I20260812 01:16:49.020776 14158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:49.020560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:58307)
0812 01:16:49.020689 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:49.020728 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
I20260812 01:16:49.049259 14159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:49.049042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:38573)
0812 01:16:49.049169 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:49.049200 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260812 01:16:49.193265 14160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:49.193049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:48829)
0812 01:16:49.193170 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:49.193201 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":63,"threads_started":1}
I20260812 01:16:49.357044 14163 raft_consensus.cc:482] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:16:49.357137 14163 raft_consensus.cc:504] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:49.357316 14163 leader_election.cc:288] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787), 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021)
W20260812 01:16:49.357893 13391 leader_election.cc:341] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021): Not found: Tablet not found: ea88ecfc27d44d109f72ebaccdedabd0
W20260812 01:16:49.357975 13391 leader_election.cc:341] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787): Not found: Tablet not found: ea88ecfc27d44d109f72ebaccdedabd0
I20260812 01:16:49.357993 13391 leader_election.cc:302] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cf9627e384e44cfb133df7fc308abc2; no voters: 70c9e6ceb12c4e4bb787156bbe052e98, a98291b969c94fa8b5b2e981dc5ad61c
I20260812 01:16:49.358068 14163 raft_consensus.cc:2726] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:16:50.021404 14166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:50.021171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:35663)
0812 01:16:50.021304 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:50.021355 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":75,"threads_started":1}
I20260812 01:16:50.049966 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:50.049741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:38153)
0812 01:16:50.049882 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:50.049923 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260812 01:16:50.194010 14169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:50.193783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:60825)
0812 01:16:50.193922 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:50.193963 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":61,"threads_started":1}
I20260812 01:16:51.022234 14170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:51.021938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:34299)
0812 01:16:51.022141 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:51.022186 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":75,"threads_started":1}
I20260812 01:16:51.050628 14171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:51.050417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:49137)
0812 01:16:51.050551 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:51.050584 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":77,"threads_started":1}
I20260812 01:16:51.194658 14172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:51.194464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:52825)
0812 01:16:51.194585 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:51.194619 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260812 01:16:52.023090 14173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:52.022820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:58633)
0812 01:16:52.022976 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:52.023037 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":65,"threads_started":1}
I20260812 01:16:52.051302 14174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:52.051054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:46013)
0812 01:16:52.051225 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:52.051259 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":111,"threads_started":1}
I20260812 01:16:52.107859 14176 raft_consensus.cc:482] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:16:52.107993 14176 raft_consensus.cc:504] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:52.108184 14176 leader_election.cc:288] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787), 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021)
W20260812 01:16:52.108657 13391 leader_election.cc:341] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787): Not found: Tablet not found: ea88ecfc27d44d109f72ebaccdedabd0
W20260812 01:16:52.108758 13391 leader_election.cc:341] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021): Not found: Tablet not found: ea88ecfc27d44d109f72ebaccdedabd0
I20260812 01:16:52.108850 13391 leader_election.cc:302] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cf9627e384e44cfb133df7fc308abc2; no voters: 70c9e6ceb12c4e4bb787156bbe052e98, a98291b969c94fa8b5b2e981dc5ad61c
I20260812 01:16:52.108966 14176 raft_consensus.cc:2726] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:16:52.195364 14178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:52.195147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:60025)
0812 01:16:52.195290 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:52.195325 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":82,"threads_started":1}
I20260812 01:16:53.023835 14180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:53.023622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:36247)
0812 01:16:53.023750 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:53.023784 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260812 01:16:53.051965 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:53.051754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:50799)
0812 01:16:53.051880 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:53.051922 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":60,"threads_started":1}
I20260812 01:16:53.196079 14182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:53.195821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:57305)
0812 01:16:53.195996 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:53.196034 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":94,"threads_started":1}
I20260812 01:16:54.024641 14183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:54.024335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:40445)
0812 01:16:54.024539 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:54.024583 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":88,"threads_started":1}
I20260812 01:16:54.052719 14185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:54.052413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:45929)
0812 01:16:54.052642 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:54.052674 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":170,"threads_started":1}
I20260812 01:16:54.197053 14186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:54.196821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:33199)
0812 01:16:54.196972 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:54.197011 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260812 01:16:54.446946 14187 raft_consensus.cc:482] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:16:54.447088 14187 raft_consensus.cc:504] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:54.447296 14187 leader_election.cc:288] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787), 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021)
W20260812 01:16:54.447654 13391 leader_election.cc:341] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787): Not found: Tablet not found: ea88ecfc27d44d109f72ebaccdedabd0
W20260812 01:16:54.447726 13391 leader_election.cc:341] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021): Not found: Tablet not found: ea88ecfc27d44d109f72ebaccdedabd0
I20260812 01:16:54.447767 13391 leader_election.cc:302] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cf9627e384e44cfb133df7fc308abc2; no voters: 70c9e6ceb12c4e4bb787156bbe052e98, a98291b969c94fa8b5b2e981dc5ad61c
I20260812 01:16:54.447849 14187 raft_consensus.cc:2726] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:16:55.025441 14188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:55.025072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:55135)
0812 01:16:55.025331 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:55.025377 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":181,"threads_started":1}
I20260812 01:16:55.053406 14189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:55.053179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:53027)
0812 01:16:55.053325 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:55.053360 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260812 01:16:55.197731 14190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:55.197512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:47919)
0812 01:16:55.197656 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:55.197691 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":81,"threads_started":1}
I20260812 01:16:56.026221 14192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:56.025959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:45111)
0812 01:16:56.026121 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:56.026171 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":95,"threads_started":1}
I20260812 01:16:56.054035 14195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:56.053823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:44661)
0812 01:16:56.053959 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:56.053991 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
I20260812 01:16:56.198643 14197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:56.198377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:57579)
0812 01:16:56.198535 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:56.198587 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":99,"threads_started":1}
I20260812 01:16:57.027029 14199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:57.026788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:51109)
0812 01:16:57.026932 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:57.026977 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":71,"threads_started":1}
I20260812 01:16:57.054709 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:57.054454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:40977)
0812 01:16:57.054633 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:57.054665 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":116,"threads_started":1}
I20260812 01:16:57.199363 14201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:57.199122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:32827)
0812 01:16:57.199279 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:57.199318 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":64,"threads_started":1}
I20260812 01:16:58.027796 14203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:58.027581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:36413)
0812 01:16:58.027711 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:58.027749 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
I20260812 01:16:58.055433 14204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:58.055192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:54419)
0812 01:16:58.055349 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:58.055384 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":97,"threads_started":1}
I20260812 01:16:58.200052 14205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:58.199828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:47537)
0812 01:16:58.199956 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:58.199999 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260812 01:16:59.028551 14206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:59.028251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:50037)
0812 01:16:59.028402 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:59.028441 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":80,"threads_started":1}
I20260812 01:16:59.056113 14208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:59.055883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:43293)
0812 01:16:59.056025 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:59.056068 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
I20260812 01:16:59.200866 14209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:16:59.200638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:58587)
0812 01:16:59.200781 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 01:16:59.200819 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
I20260812 01:16:59.496215 14210 raft_consensus.cc:482] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:16:59.496403 14210 raft_consensus.cc:504] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a98291b969c94fa8b5b2e981dc5ad61c" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 35787 } } peers { permanent_uuid: "70c9e6ceb12c4e4bb787156bbe052e98" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 37021 } } peers { permanent_uuid: "2cf9627e384e44cfb133df7fc308abc2" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 45573 } }
I20260812 01:16:59.496635 14210 leader_election.cc:288] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787), 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021)
W20260812 01:16:59.497062 13391 leader_election.cc:341] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70c9e6ceb12c4e4bb787156bbe052e98 (127.17.183.130:37021): Not found: Tablet not found: ea88ecfc27d44d109f72ebaccdedabd0
W20260812 01:16:59.497148 13391 leader_election.cc:341] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a98291b969c94fa8b5b2e981dc5ad61c (127.17.183.131:35787): Not found: Tablet not found: ea88ecfc27d44d109f72ebaccdedabd0
I20260812 01:16:59.497186 13391 leader_election.cc:302] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cf9627e384e44cfb133df7fc308abc2; no voters: 70c9e6ceb12c4e4bb787156bbe052e98, a98291b969c94fa8b5b2e981dc5ad61c
I20260812 01:16:59.497298 14210 raft_consensus.cc:2726] T ea88ecfc27d44d109f72ebaccdedabd0 P 2cf9627e384e44cfb133df7fc308abc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:17:00.029325 14211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:00.029037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:58717)
0812 01:17:00.029198 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:00.029239 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
I20260812 01:17:00.056763 14214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:00.056555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:34517)
0812 01:17:00.056672 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:00.056705 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
I20260812 01:17:00.201550 14215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:00.201307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:56475)
0812 01:17:00.201471 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:00.201504 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":77,"threads_started":1}
I20260812 01:17:01.030053 14216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:01.029841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.129:39457)
0812 01:17:01.029971 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:01.030003 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260812 01:17:01.057476 14219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:01.057266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.130:57405)
0812 01:17:01.057387 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:01.057432 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":67,"threads_started":1}
I20260812 01:17:01.196297 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 13309
I20260812 01:17:01.218878 14220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:01.217593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:44861 (local address 127.17.183.131:55201)
0812 01:17:01.218757 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:01.218816 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:44861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1144,"thread_start_us":1070,"threads_started":1}
I20260812 01:17:01.224988 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 13618
I20260812 01:17:01.235507 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 13865
2026-08-12T01:17:01Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18733 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:17:01 dist-test-slave-rwrg krb5kdc[14225](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:17:01 dist-test-slave-rwrg krb5kdc[14225](info): set up 2 sockets
Aug 12 01:17:01 dist-test-slave-rwrg krb5kdc[14225](info): commencing operation
krb5kdc: starting...
W20260812 01:17:02.535681 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:17:02 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:17:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:17:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:17:02.675347 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43815
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:43815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:17:02.757321 14255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:02.757516 14255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:02.757537 14255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:02.758615 14255 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 01:17:02.758651 14255 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 01:17:02.758663 14255 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 01:17:02.758673 14255 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:17:02.758726 14255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:02.758744 14255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:02.758764 14255 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:17:02.758786 14255 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:17:02.760202 14255 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:43815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:02.760511 14255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:02.760776 14255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:17:02.765421 14268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:02.765417 14269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:02.765643 14255 server_base.cc:1034] running on GCE node
W20260812 01:17:02.765424 14272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:02.765969 14255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:02.766296 14255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:02.767467 14255 hybrid_clock.cc:648] HybridClock initialized: now 1786497422767460 us; error 35 us; skew 500 ppm
Aug 12 01:17:02 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497422, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:02.770114 14255 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:17:02.770546 14255 webserver.cc:460] Webserver started at http://127.17.183.190:41475/ using document root <none> and password file <none>
I20260812 01:17:02.770803 14255 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:02.770884 14255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:02.771034 14255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:17:02.772059 14255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "e539f563444c4ab3a61a7d7a991ef406"
format_stamp: "Formatted at 2026-08-12 01:17:02 on dist-test-slave-rwrg"
server_key: "5de1846e6aaeedae3d04ff61470aa4aa"
server_key_iv: "6d66e98c7fa320270ab71e2275de81f3"
server_key_version: "encryptionkey@0"
I20260812 01:17:02.772411 14255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "e539f563444c4ab3a61a7d7a991ef406"
format_stamp: "Formatted at 2026-08-12 01:17:02 on dist-test-slave-rwrg"
server_key: "5de1846e6aaeedae3d04ff61470aa4aa"
server_key_iv: "6d66e98c7fa320270ab71e2275de81f3"
server_key_version: "encryptionkey@0"
I20260812 01:17:02.773788 14255 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:17:02.774520 14283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:02.774689 14255 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:02.774808 14255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "e539f563444c4ab3a61a7d7a991ef406"
format_stamp: "Formatted at 2026-08-12 01:17:02 on dist-test-slave-rwrg"
server_key: "5de1846e6aaeedae3d04ff61470aa4aa"
server_key_iv: "6d66e98c7fa320270ab71e2275de81f3"
server_key_version: "encryptionkey@0"
I20260812 01:17:02.774883 14255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:02.783649 14255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:02.785645 14255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:02.785818 14255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:02.789949 14255 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:43815
I20260812 01:17:02.789980 14392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:43815 every 8 connection(s)
I20260812 01:17:02.790334 14255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:17:02.791193 14394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:17:02.793475 14394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Bootstrap starting.
I20260812 01:17:02.794052 14394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Neither blocks nor log segments found. Creating new log.
I20260812 01:17:02.794354 14394 log.cc:824] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Log is configured to *not* fsync() on all Append() calls
I20260812 01:17:02.794998 14394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: No bootstrap required, opened a new log
I20260812 01:17:02.796638 14394 raft_consensus.cc:348] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:02.796768 14394 raft_consensus.cc:374] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:17:02.796810 14394 raft_consensus.cc:729] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e539f563444c4ab3a61a7d7a991ef406, State: Initialized, Role: FOLLOWER
I20260812 01:17:02.796978 14394 consensus_queue.cc:260] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:02.797062 14394 raft_consensus.cc:388] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:17:02.797114 14394 raft_consensus.cc:482] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:17:02.797163 14394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:17:02.797672 14394 raft_consensus.cc:504] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:02.797820 14394 leader_election.cc:302] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e539f563444c4ab3a61a7d7a991ef406; no voters:
I20260812 01:17:02.798004 14394 leader_election.cc:288] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:17:02.798048 14397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:17:02.798202 14397 raft_consensus.cc:686] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 1 LEADER]: Becoming Leader. State: Replica: e539f563444c4ab3a61a7d7a991ef406, State: Running, Role: LEADER
I20260812 01:17:02.798270 14394 sys_catalog.cc:564] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:17:02.798385 14397 consensus_queue.cc:237] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:02.798786 14398 sys_catalog.cc:455] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e539f563444c4ab3a61a7d7a991ef406" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } } }
I20260812 01:17:02.798799 14401 sys_catalog.cc:455] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e539f563444c4ab3a61a7d7a991ef406. Latest consensus state: current_term: 1 leader_uuid: "e539f563444c4ab3a61a7d7a991ef406" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } } }
I20260812 01:17:02.798954 14401 sys_catalog.cc:458] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: This master's current role is: LEADER
I20260812 01:17:02.799187 14398 sys_catalog.cc:458] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: This master's current role is: LEADER
I20260812 01:17:02.799373 14410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:17:02.799865 14410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:17:02.800485 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 14255
I20260812 01:17:02.800626 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:17:02.800832 18142 external_mini_cluster.cc:1428] Setting key 77cbae444084c784172ed54b6d208e80
I20260812 01:17:02.802003 14410 catalog_manager.cc:1347] Generated new cluster ID: 8feed5aec09340b9bfe753779a9edbf4
I20260812 01:17:02.802050 14410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:17:02 dist-test-slave-rwrg krb5kdc[14225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:17:02.811532 14410 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:17:02.812232 14410 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:17:02.812937 14427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:02.801625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43750 (local address 127.17.183.190:43815)
0812 01:17:02.801779 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:02.801788 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:02.801823 (+ 35us) server_negotiation.cc:407] Connection header received
0812 01:17:02.801974 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:02.801982 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:02.802037 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:02.802901 (+ 864us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:02.802986 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:02.804286 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:02.805473 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:02.806064 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:02.806158 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:02.809143 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:02.809147 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:02.809147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:02.809160 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:02.811190 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:02.811639 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:02.811642 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:02.811643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:02.811742 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:02.811967 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:02.811968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:02.811968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:02.812189 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:02.812336 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:02.812543 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 01:17:02.812722 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":86,"threads_started":1}
I20260812 01:17:02.817251 14410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Generated new TSK 0
I20260812 01:17:02.817411 14410 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:17:02.851032 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43815
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:17:02.935214 14433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:02.935413 14433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:02.935436 14433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:02.936635 14433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:02.936678 14433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:02.936705 14433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:17:02.938129 14433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:02.938330 14433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:02.938503 14433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:17:02.943605 14445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:02.943539 14442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:02.943574 14441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:02.943811 14433 server_base.cc:1034] running on GCE node
I20260812 01:17:02.944065 14433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:02.944303 14433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:02.945492 14433 hybrid_clock.cc:648] HybridClock initialized: now 1786497422945470 us; error 33 us; skew 500 ppm
Aug 12 01:17:02 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497422, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:02.947980 14433 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:17:02.948446 14433 webserver.cc:460] Webserver started at http://127.17.183.129:45827/ using document root <none> and password file <none>
I20260812 01:17:02.948704 14433 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:02.948774 14433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:02.948927 14433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:17:02.949960 14433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "2fa4d5b142714f828ce55731fc3d1ce7"
format_stamp: "Formatted at 2026-08-12 01:17:02 on dist-test-slave-rwrg"
server_key: "dfe5158a8431ceebc1357acebcd8a003"
server_key_iv: "7334f7a532d3b8d6e7daf089be105228"
server_key_version: "encryptionkey@0"
I20260812 01:17:02.950357 14433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "2fa4d5b142714f828ce55731fc3d1ce7"
format_stamp: "Formatted at 2026-08-12 01:17:02 on dist-test-slave-rwrg"
server_key: "dfe5158a8431ceebc1357acebcd8a003"
server_key_iv: "7334f7a532d3b8d6e7daf089be105228"
server_key_version: "encryptionkey@0"
I20260812 01:17:02.951683 14433 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:17:02.952448 14458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:02.952653 14433 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:17:02.952756 14433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "2fa4d5b142714f828ce55731fc3d1ce7"
format_stamp: "Formatted at 2026-08-12 01:17:02 on dist-test-slave-rwrg"
server_key: "dfe5158a8431ceebc1357acebcd8a003"
server_key_iv: "7334f7a532d3b8d6e7daf089be105228"
server_key_version: "encryptionkey@0"
I20260812 01:17:02.952831 14433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:02.962709 14433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:02.964478 14433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:02.964694 14433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:02.964917 14433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:17:02.965214 14433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:17:02.965250 14433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:02.965307 14433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:17:02.965340 14433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:02.971673 14433 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:37417
I20260812 01:17:02.971733 14695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:37417 every 8 connection(s)
I20260812 01:17:02.972016 14433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:17:02.976468 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 14433
I20260812 01:17:02.976595 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:17:02.976815 18142 external_mini_cluster.cc:1428] Setting key f5cf3fa0ae1be4c1eb1f50e496f28a29
Aug 12 01:17:02 dist-test-slave-rwrg krb5kdc[14225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497422, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:17:02.981715 14427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:02.972758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:43189 (local address 127.17.183.190:43815)
0812 01:17:02.972821 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:02.972823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:02.973023 (+ 200us) server_negotiation.cc:407] Connection header received
0812 01:17:02.973501 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:02.973503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:02.973512 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:02.973558 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:02.974404 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:02.974886 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:02.975798 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:02.975981 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:02.976030 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:02.978595 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:02.978596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:02.978597 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:02.978605 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:02.980138 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:02.980692 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:02.980694 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:02.980694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:02.980751 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:02.981044 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:02.981046 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:02.981046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:02.981179 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:02.981257 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:02.981535 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 01:17:02.981626 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 01:17:02.981895 14702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:02.972695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:43189)
0812 01:17:02.972899 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:02.972933 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:02.973405 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:02.973606 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:02.973609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:02.974140 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:17:02.974326 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:02.974330 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:02.974966 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:02.974967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:02.975718 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:02.975720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:02.976054 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:02.976055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:02.976153 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:02.976764 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:17:02.976772 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:17:02.978458 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:17:02.980222 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:02.980234 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:02.980236 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:02.980607 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:02.980817 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:02.980818 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:02.980819 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:02.980965 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:02.981259 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:17:02.981267 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:17:02.981400 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 01:17:02.981499 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 01:17:02.981658 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":69,"threads_started":1}
I20260812 01:17:02.982467 14696 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43815
I20260812 01:17:02.982568 14696 heartbeater.cc:464] Registering TS with master...
I20260812 01:17:02.982746 14696 heartbeater.cc:511] Master 127.17.183.190:43815 requested a full tablet report, sending...
I20260812 01:17:02.983347 14320 ts_manager.cc:194] Registered new tserver with Master: 2fa4d5b142714f828ce55731fc3d1ce7 (127.17.183.129:37417)
I20260812 01:17:02.984302 14320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:43189
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:17:03.003788 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43815
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:17:03.088346 14707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:03.088567 14707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:03.088591 14707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:03.089779 14707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:03.089823 14707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:03.089875 14707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:17:03.091318 14707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:03.091509 14707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:03.091749 14707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:17:03.096730 14717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:03.096797 14716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:03.096925 14707 server_base.cc:1034] running on GCE node
W20260812 01:17:03.096951 14725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:03.097163 14707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:03.097415 14707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:03.098567 14707 hybrid_clock.cc:648] HybridClock initialized: now 1786497423098545 us; error 42 us; skew 500 ppm
Aug 12 01:17:03 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497423, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:03.101151 14707 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:17:03.101626 14707 webserver.cc:460] Webserver started at http://127.17.183.130:46803/ using document root <none> and password file <none>
I20260812 01:17:03.101868 14707 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:03.101934 14707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:03.102082 14707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:17:03.103070 14707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "d6d7070d32194e3691b9484dc2aca5e2"
format_stamp: "Formatted at 2026-08-12 01:17:03 on dist-test-slave-rwrg"
server_key: "3805c15208bb71bca066f65435dc7073"
server_key_iv: "2a3f256950ceb5d403a5fe6c621d0997"
server_key_version: "encryptionkey@0"
I20260812 01:17:03.103422 14707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "d6d7070d32194e3691b9484dc2aca5e2"
format_stamp: "Formatted at 2026-08-12 01:17:03 on dist-test-slave-rwrg"
server_key: "3805c15208bb71bca066f65435dc7073"
server_key_iv: "2a3f256950ceb5d403a5fe6c621d0997"
server_key_version: "encryptionkey@0"
I20260812 01:17:03.104887 14707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:17:03.105623 14735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:03.105798 14707 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:17:03.105886 14707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "d6d7070d32194e3691b9484dc2aca5e2"
format_stamp: "Formatted at 2026-08-12 01:17:03 on dist-test-slave-rwrg"
server_key: "3805c15208bb71bca066f65435dc7073"
server_key_iv: "2a3f256950ceb5d403a5fe6c621d0997"
server_key_version: "encryptionkey@0"
I20260812 01:17:03.105978 14707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:03.116087 14707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:03.118317 14707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:03.118506 14707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:03.118782 14707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:17:03.119119 14707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:17:03.119180 14707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:03.119220 14707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:17:03.119270 14707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:03.125948 14707 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:42845
I20260812 01:17:03.126029 14962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:42845 every 8 connection(s)
I20260812 01:17:03.126330 14707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:17:03.128686 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 14707
I20260812 01:17:03.128821 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:17:03.129089 18142 external_mini_cluster.cc:1428] Setting key 122feb7822915b968a4cdc7e1ff65a59
Aug 12 01:17:03 dist-test-slave-rwrg krb5kdc[14225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497423, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:17:03.136664 14427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.127056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:35977 (local address 127.17.183.190:43815)
0812 01:17:03.127114 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:03.127116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:03.127260 (+ 144us) server_negotiation.cc:407] Connection header received
0812 01:17:03.127756 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:03.127758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:03.127770 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:03.127836 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:03.128792 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.129573 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.130660 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.130970 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.131065 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.133645 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:03.133646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:03.133646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:03.133653 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:03.135093 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:03.135612 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:03.135613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:03.135613 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:03.135662 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:03.135978 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:03.135979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:03.135979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:03.136076 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:03.136124 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:03.136478 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 01:17:03.136603 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 01:17:03.136945 14967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.126982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:35977)
0812 01:17:03.127134 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:03.127173 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:03.127658 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:03.127898 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:03.127901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:03.128457 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:17:03.128683 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.128688 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.129688 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.129689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.130562 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.130565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.131078 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.131079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.131182 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.131713 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:17:03.131722 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:17:03.133547 (+ 1825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:17:03.135179 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:03.135189 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:03.135191 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:03.135529 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:03.135729 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:03.135730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:03.135730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:03.135903 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:03.136145 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:17:03.136152 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:17:03.136330 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 01:17:03.136467 (+ 137us) client_negotiation.cc:240] Negotiation successful
0812 01:17:03.136688 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260812 01:17:03.137516 14964 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43815
I20260812 01:17:03.137633 14964 heartbeater.cc:464] Registering TS with master...
I20260812 01:17:03.137840 14964 heartbeater.cc:511] Master 127.17.183.190:43815 requested a full tablet report, sending...
I20260812 01:17:03.138319 14320 ts_manager.cc:194] Registered new tserver with Master: d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845)
I20260812 01:17:03.138696 14320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:35977
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:17:03.156666 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43815
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:17:03.239753 14974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:03.239945 14974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:03.239970 14974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:03.241211 14974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:03.241257 14974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:03.241286 14974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:17:03.242666 14974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:03.242851 14974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:03.243026 14974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:17:03.248148 14989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:03.248135 14994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:03.248237 14988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:03.248435 14974 server_base.cc:1034] running on GCE node
I20260812 01:17:03.248733 14974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:03.248931 14974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:03.250108 14974 hybrid_clock.cc:648] HybridClock initialized: now 1786497423250085 us; error 33 us; skew 500 ppm
Aug 12 01:17:03 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497423, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:03.252779 14974 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:17:03.253250 14974 webserver.cc:460] Webserver started at http://127.17.183.131:35805/ using document root <none> and password file <none>
I20260812 01:17:03.253458 14974 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:03.253522 14974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:03.253623 14974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:17:03.254673 14974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "5576cbd093d941aeb3259887c2535ea7"
format_stamp: "Formatted at 2026-08-12 01:17:03 on dist-test-slave-rwrg"
server_key: "ec07bb6f6c8f5ee3aa581fe840554889"
server_key_iv: "a74ee71f4844e035cc8e4270ea9a40b0"
server_key_version: "encryptionkey@0"
I20260812 01:17:03.254983 14974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "5576cbd093d941aeb3259887c2535ea7"
format_stamp: "Formatted at 2026-08-12 01:17:03 on dist-test-slave-rwrg"
server_key: "ec07bb6f6c8f5ee3aa581fe840554889"
server_key_iv: "a74ee71f4844e035cc8e4270ea9a40b0"
server_key_version: "encryptionkey@0"
I20260812 01:17:03.256415 14974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:17:03.257232 15008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:03.257426 14974 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:17:03.257552 14974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "5576cbd093d941aeb3259887c2535ea7"
format_stamp: "Formatted at 2026-08-12 01:17:03 on dist-test-slave-rwrg"
server_key: "ec07bb6f6c8f5ee3aa581fe840554889"
server_key_iv: "a74ee71f4844e035cc8e4270ea9a40b0"
server_key_version: "encryptionkey@0"
I20260812 01:17:03.257611 14974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:03.288297 14974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:03.290195 14974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:03.290326 14974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:03.290527 14974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:17:03.290786 14974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:17:03.290820 14974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:03.290843 14974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:17:03.290854 14974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:03.297261 14974 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:43181
I20260812 01:17:03.297338 15237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:43181 every 8 connection(s)
I20260812 01:17:03.297653 14974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:17:03.301801 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 14974
I20260812 01:17:03.301926 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:17:03.302127 18142 external_mini_cluster.cc:1428] Setting key c62d914546a574c9807235c26a7f62a3
Aug 12 01:17:03 dist-test-slave-rwrg krb5kdc[14225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497423, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:17:03.307554 14427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.298543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:49629 (local address 127.17.183.190:43815)
0812 01:17:03.298618 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:03.298620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:03.298829 (+ 209us) server_negotiation.cc:407] Connection header received
0812 01:17:03.299501 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:03.299502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:03.299515 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:03.299582 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:03.300623 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.301134 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.302294 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.302587 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.302627 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.304914 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:03.304916 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:03.304916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:03.304924 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:03.306077 (+ 1153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:03.306559 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:03.306560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:03.306561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:03.306626 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:03.306896 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:03.306897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:03.306897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:03.307015 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:03.307091 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:03.307363 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 01:17:03.307448 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 01:17:03.307731 15243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.298509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:49629)
0812 01:17:03.298703 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:03.298747 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:03.299382 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:03.299674 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:03.299684 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:03.300284 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:17:03.300493 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.300543 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.301236 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.301237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.302174 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.302177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.302724 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.302725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.302887 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.303343 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:17:03.303351 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:17:03.304819 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:17:03.306194 (+ 1375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:03.306202 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:03.306204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:03.306476 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:03.306700 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:03.306701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:03.306701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:03.306821 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:03.307082 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:17:03.307089 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:17:03.307227 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 01:17:03.307339 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 01:17:03.307507 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":115,"threads_started":1}
I20260812 01:17:03.308240 15241 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43815
I20260812 01:17:03.308324 15241 heartbeater.cc:464] Registering TS with master...
I20260812 01:17:03.308568 15241 heartbeater.cc:511] Master 127.17.183.190:43815 requested a full tablet report, sending...
I20260812 01:17:03.309036 14320 ts_manager.cc:194] Registered new tserver with Master: 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181)
I20260812 01:17:03.309440 14320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:49629
I20260812 01:17:03.313825 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:17:03.320657 14427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.315172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43760 (local address 127.17.183.190:43815)
0812 01:17:03.315232 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:03.315233 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:03.315319 (+ 86us) server_negotiation.cc:407] Connection header received
0812 01:17:03.315389 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:03.315390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:03.315398 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:03.315464 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:03.315995 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.316422 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.317209 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.317420 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.317468 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.318599 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:03.318600 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:03.318600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:03.318605 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:03.319668 (+ 1063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:03.319963 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:03.319964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:03.319964 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:03.320011 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:03.320173 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:03.320174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:03.320174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:03.320325 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:03.320397 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:03.320487 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 01:17:03.320601 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 01:17:03.322067 14320 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:17:03.323637 14320 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:17:03.330269 15263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.326068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:43181 (local address 127.0.0.1:35364)
0812 01:17:03.326229 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:03.326271 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:03.326335 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:03.326875 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:03.326878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:03.326880 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:17:03.326940 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.326942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.327861 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.327862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.329029 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.329032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.329938 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.329939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.330038 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.330054 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 01:17:03.330122 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 01:17:03.330179 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":59,"threads_started":1}
I20260812 01:17:03.330384 15265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.326278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:42845 (local address 127.0.0.1:55144)
0812 01:17:03.326599 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:03.326609 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:03.326646 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:03.326920 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:03.326921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:03.326923 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:17:03.326968 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.326971 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.328301 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.328302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.329373 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.329375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.330122 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.330123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.330184 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.330188 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:17:03.330244 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 01:17:03.330283 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":2,"thread_start_us":77,"threads_started":1}
I20260812 01:17:03.330643 15272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.326430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35364 (local address 127.17.183.131:43181)
0812 01:17:03.326626 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:03.326629 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:03.326638 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:17:03.326676 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:03.326678 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:03.326693 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:03.326787 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:17:03.327006 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.327740 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.329119 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.329844 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.329919 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.329970 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:03.330223 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 01:17:03.330266 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":99,"threads_started":1}
I20260812 01:17:03.330662 15259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.326087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:37417 (local address 127.0.0.1:33578)
0812 01:17:03.326235 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:03.326366 (+ 131us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:03.326437 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:03.327017 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:03.327017 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:03.327019 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:17:03.327060 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.327061 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.328347 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.328348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.329496 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.329499 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.330462 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.330464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.330525 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.330529 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:17:03.330561 (+ 32us) client_negotiation.cc:240] Negotiation successful
0812 01:17:03.330603 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":3,"thread_start_us":79,"threads_started":1}
I20260812 01:17:03.330672 15266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.326391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55144 (local address 127.17.183.130:42845)
0812 01:17:03.326621 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:03.326627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:03.326656 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:17:03.326721 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:03.326723 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:03.326772 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:03.326839 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:17:03.327045 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.328186 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.329473 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.330025 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.330108 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.330164 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:03.330537 (+ 373us) server_negotiation.cc:299] Negotiation successful
0812 01:17:03.330588 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":103,"threads_started":1}
I20260812 01:17:03.331041 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.326163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33578 (local address 127.17.183.129:37417)
0812 01:17:03.326571 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:03.326576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:03.326587 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:17:03.326631 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:03.326634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:03.326650 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:03.326764 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:17:03.327122 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.328226 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.329604 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.330364 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.330830 (+ 466us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.330888 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:03.330909 (+ 21us) server_negotiation.cc:299] Negotiation successful
0812 01:17:03.330963 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":103,"threads_started":1}
I20260812 01:17:03.331447 15101 tablet_service.cc:1467] Processing CreateTablet for tablet 1142777ceb7f4314abf1da8ed69f1b0f (DEFAULT_TABLE table=test-table [id=0642a7f0779f4493a48578df15a89ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:17:03.331480 14838 tablet_service.cc:1467] Processing CreateTablet for tablet 1142777ceb7f4314abf1da8ed69f1b0f (DEFAULT_TABLE table=test-table [id=0642a7f0779f4493a48578df15a89ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:17:03.331599 14571 tablet_service.cc:1467] Processing CreateTablet for tablet 1142777ceb7f4314abf1da8ed69f1b0f (DEFAULT_TABLE table=test-table [id=0642a7f0779f4493a48578df15a89ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:17:03.331825 15101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1142777ceb7f4314abf1da8ed69f1b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:17:03.331888 14571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1142777ceb7f4314abf1da8ed69f1b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:17:03.331889 14838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1142777ceb7f4314abf1da8ed69f1b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:17:03.334769 15273 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Bootstrap starting.
I20260812 01:17:03.335208 15274 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Bootstrap starting.
I20260812 01:17:03.335391 15275 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7: Bootstrap starting.
I20260812 01:17:03.335608 15273 tablet_bootstrap.cc:654] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Neither blocks nor log segments found. Creating new log.
I20260812 01:17:03.335880 15274 tablet_bootstrap.cc:654] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Neither blocks nor log segments found. Creating new log.
I20260812 01:17:03.336127 15275 tablet_bootstrap.cc:654] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7: Neither blocks nor log segments found. Creating new log.
I20260812 01:17:03.336272 15273 log.cc:824] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Log is configured to *not* fsync() on all Append() calls
I20260812 01:17:03.336470 15274 log.cc:824] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:17:03.336742 15275 log.cc:824] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:17:03.337307 15274 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: No bootstrap required, opened a new log
I20260812 01:17:03.337387 15274 ts_tablet_manager.cc:1397] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:17:03.337456 15275 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7: No bootstrap required, opened a new log
I20260812 01:17:03.337507 15273 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: No bootstrap required, opened a new log
I20260812 01:17:03.337520 15275 ts_tablet_manager.cc:1397] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 01:17:03.337584 15273 ts_tablet_manager.cc:1397] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 01:17:03.338821 15275 raft_consensus.cc:348] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:03.339007 15275 raft_consensus.cc:374] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:17:03.339052 15275 raft_consensus.cc:729] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5576cbd093d941aeb3259887c2535ea7, State: Initialized, Role: FOLLOWER
I20260812 01:17:03.339177 15275 consensus_queue.cc:260] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:03.339495 15275 ts_tablet_manager.cc:1428] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 01:17:03.339520 15241 heartbeater.cc:503] Master 127.17.183.190:43815 was elected leader, sending a full tablet report...
I20260812 01:17:03.339490 15273 raft_consensus.cc:348] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:03.339664 15273 raft_consensus.cc:374] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:17:03.339700 15273 raft_consensus.cc:729] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d7070d32194e3691b9484dc2aca5e2, State: Initialized, Role: FOLLOWER
I20260812 01:17:03.339828 15273 consensus_queue.cc:260] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:03.339428 15274 raft_consensus.cc:348] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:03.339927 15274 raft_consensus.cc:374] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:17:03.339980 15274 raft_consensus.cc:729] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa4d5b142714f828ce55731fc3d1ce7, State: Initialized, Role: FOLLOWER
I20260812 01:17:03.340117 15273 ts_tablet_manager.cc:1428] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 01:17:03.340277 14964 heartbeater.cc:503] Master 127.17.183.190:43815 was elected leader, sending a full tablet report...
I20260812 01:17:03.340647 15274 consensus_queue.cc:260] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:03.340982 14696 heartbeater.cc:503] Master 127.17.183.190:43815 was elected leader, sending a full tablet report...
I20260812 01:17:03.341122 15274 ts_tablet_manager.cc:1428] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
W20260812 01:17:03.376964 14965 tablet.cc:2369] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:17:03.472867 14699 tablet.cc:2369] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:17:03.472894 15287 raft_consensus.cc:482] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:17:03.473058 15287 raft_consensus.cc:504] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:03.473547 15287 leader_election.cc:288] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa4d5b142714f828ce55731fc3d1ce7 (127.17.183.129:37417), d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845)
I20260812 01:17:03.476632 15243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.473740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:37417 (local address 127.17.183.131:39525)
0812 01:17:03.473832 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:03.473847 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:03.473909 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:03.474095 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:03.474096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:03.474098 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:17:03.474179 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.474181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.474944 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.474945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.475732 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.475734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.476351 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.476352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.476434 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.476438 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:17:03.476521 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 01:17:03.476565 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 01:17:03.476670 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.473797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:39525 (local address 127.17.183.129:37417)
0812 01:17:03.473865 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:03.473867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:03.473890 (+ 23us) server_negotiation.cc:407] Connection header received
0812 01:17:03.473979 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:03.473980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:03.473991 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:03.474039 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:17:03.474263 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.474858 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.475839 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.476269 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.476322 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.476329 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:03.476529 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 01:17:03.476566 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 01:17:03.476797 15294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.473853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:42845 (local address 127.17.183.131:38345)
0812 01:17:03.474027 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:03.474036 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:03.474103 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:03.474353 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:03.474354 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:03.474355 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:17:03.474425 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.474426 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.475101 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.475101 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.475874 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:03.475876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.476534 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.476535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:03.476605 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.476609 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:17:03.476666 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 01:17:03.476707 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":14,"thread_start_us":122,"threads_started":1}
I20260812 01:17:03.476809 15266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.473928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:38345 (local address 127.17.183.130:42845)
0812 01:17:03.473975 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:03.473977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:03.474106 (+ 129us) server_negotiation.cc:407] Connection header received
0812 01:17:03.474161 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:03.474162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:03.474175 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:03.474323 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:17:03.474505 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.474991 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.475967 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.476421 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.476519 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.476528 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:03.476688 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 01:17:03.476733 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:17:03.477115 14873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1142777ceb7f4314abf1da8ed69f1b0f" candidate_uuid: "5576cbd093d941aeb3259887c2535ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d7070d32194e3691b9484dc2aca5e2" is_pre_election: true
I20260812 01:17:03.477216 14611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1142777ceb7f4314abf1da8ed69f1b0f" candidate_uuid: "5576cbd093d941aeb3259887c2535ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" is_pre_election: true
I20260812 01:17:03.477355 14873 raft_consensus.cc:2454] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5576cbd093d941aeb3259887c2535ea7 in term 0.
I20260812 01:17:03.477363 14611 raft_consensus.cc:2454] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5576cbd093d941aeb3259887c2535ea7 in term 0.
I20260812 01:17:03.477584 15009 leader_election.cc:302] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa4d5b142714f828ce55731fc3d1ce7, 5576cbd093d941aeb3259887c2535ea7; no voters:
I20260812 01:17:03.477726 15287 raft_consensus.cc:2781] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:17:03.477783 15287 raft_consensus.cc:482] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:17:03.477813 15287 raft_consensus.cc:3037] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:17:03.478646 15287 raft_consensus.cc:504] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:03.478778 15287 leader_election.cc:288] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa4d5b142714f828ce55731fc3d1ce7 (127.17.183.129:37417), d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845)
I20260812 01:17:03.478984 14611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1142777ceb7f4314abf1da8ed69f1b0f" candidate_uuid: "5576cbd093d941aeb3259887c2535ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa4d5b142714f828ce55731fc3d1ce7"
I20260812 01:17:03.479013 14873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1142777ceb7f4314abf1da8ed69f1b0f" candidate_uuid: "5576cbd093d941aeb3259887c2535ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d7070d32194e3691b9484dc2aca5e2"
I20260812 01:17:03.479068 14611 raft_consensus.cc:3037] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:17:03.479085 14873 raft_consensus.cc:3037] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:17:03.479949 14611 raft_consensus.cc:2454] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5576cbd093d941aeb3259887c2535ea7 in term 1.
I20260812 01:17:03.479949 14873 raft_consensus.cc:2454] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5576cbd093d941aeb3259887c2535ea7 in term 1.
I20260812 01:17:03.480115 15009 leader_election.cc:302] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5576cbd093d941aeb3259887c2535ea7, d6d7070d32194e3691b9484dc2aca5e2; no voters:
I20260812 01:17:03.480213 15287 raft_consensus.cc:2781] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:17:03.480381 15287 raft_consensus.cc:686] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 1 LEADER]: Becoming Leader. State: Replica: 5576cbd093d941aeb3259887c2535ea7, State: Running, Role: LEADER
I20260812 01:17:03.480480 15287 consensus_queue.cc:237] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:03.481330 14315 catalog_manager.cc:5495] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131). New cstate: current_term: 1 leader_uuid: "5576cbd093d941aeb3259887c2535ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } health_report { overall_health: UNKNOWN } } }
I20260812 01:17:03.514142 15272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.511684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35366 (local address 127.17.183.131:43181)
0812 01:17:03.511756 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:03.511758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:03.511773 (+ 15us) server_negotiation.cc:407] Connection header received
0812 01:17:03.511811 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:03.511812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:03.511830 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:03.511911 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:17:03.512173 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.512699 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.513414 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:03.513595 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:03.513645 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:03.513790 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:17:03.513890 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:17:03.513954 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:03.513991 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 01:17:03.514009 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 01:17:03.516196 14873 raft_consensus.cc:1261] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Refusing update from remote peer 5576cbd093d941aeb3259887c2535ea7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:17:03.516196 14611 raft_consensus.cc:1261] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Refusing update from remote peer 5576cbd093d941aeb3259887c2535ea7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:17:03.516633 15287 consensus_queue.cc:1035] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:17:03.516796 15295 consensus_queue.cc:1035] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:17:03.519498 15301 mvcc.cc:205] Tried to move back new op lower bound from 7317493446719254528 to 7317493446576783360. Current Snapshot: MvccSnapshot[applied={T|T < 7317493446719254528}]
I20260812 01:17:03.521633 14315 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:17:03.521719 14315 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:17:03.522524 14315 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Sending DeleteTablet for 3 replicas of tablet 1142777ceb7f4314abf1da8ed69f1b0f
I20260812 01:17:03.522864 14571 tablet_service.cc:1514] Processing DeleteTablet for tablet 1142777ceb7f4314abf1da8ed69f1b0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:17:03 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:33578
I20260812 01:17:03.522854 15101 tablet_service.cc:1514] Processing DeleteTablet for tablet 1142777ceb7f4314abf1da8ed69f1b0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:17:03 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:35364
I20260812 01:17:03.522905 14838 tablet_service.cc:1514] Processing DeleteTablet for tablet 1142777ceb7f4314abf1da8ed69f1b0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:17:03 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:55144
I20260812 01:17:03.522953 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 14433
I20260812 01:17:03.529034 15322 tablet_replica.cc:330] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7: stopping tablet replica
I20260812 01:17:03.529173 15322 raft_consensus.cc:2229] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:17:03.529348 15322 raft_consensus.cc:2258] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:17:03.533141 15322 ts_tablet_manager.cc:1905] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:17:03.533409 15323 tablet_replica.cc:330] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: stopping tablet replica
I20260812 01:17:03.533617 15323 raft_consensus.cc:2229] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:17:03.533849 15323 raft_consensus.cc:2258] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:17:03.534400 15323 ts_tablet_manager.cc:1905] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 01:17:03.534582 14284 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:37417 (error 108)
I20260812 01:17:03.534970 15322 ts_tablet_manager.cc:1918] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:17:03.535048 15322 log.cc:1196] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/1142777ceb7f4314abf1da8ed69f1b0f
I20260812 01:17:03.535219 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 14707
I20260812 01:17:03.538043 15265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.535349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:37417 (local address 127.0.0.1:33594)
0812 01:17:03.537953 (+ 2604us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:03.538006 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:37417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2578}
I20260812 01:17:03.540536 15322 ts_tablet_manager.cc:1939] T 1142777ceb7f4314abf1da8ed69f1b0f P 5576cbd093d941aeb3259887c2535ea7: Deleting consensus metadata
I20260812 01:17:03.545068 14291 catalog_manager.cc:4841] TS 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181): tablet 1142777ceb7f4314abf1da8ed69f1b0f (table test-table [id=0642a7f0779f4493a48578df15a89ae6]) successfully deleted
W20260812 01:17:03.546785 14284 catalog_manager.cc:4584] TS 2fa4d5b142714f828ce55731fc3d1ce7 (127.17.183.129:37417): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1142777ceb7f4314abf1da8ed69f1b0f: Network error: Client connection negotiation failed: client connection to 127.17.183.129:37417: connect: Connection refused (error 111)
I20260812 01:17:03.551573 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 14974
I20260812 01:17:03.551595 15265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:03.551472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:42845 (local address 127.0.0.1:55150)
0812 01:17:03.551523 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:03.551548 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.130:42845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 01:17:03.561702 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 14255
I20260812 01:17:23.574397 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43815
--webserver_interface=127.17.183.190
--webserver_port=41475
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:43815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:17:23.657655 15325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:23.657950 15325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:23.658016 15325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:23.659173 15325 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 01:17:23.659216 15325 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 01:17:23.659229 15325 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 01:17:23.659251 15325 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:17:23.659268 15325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:23.659283 15325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:23.659296 15325 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:17:23.659307 15325 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:17:23.660862 15325 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:43815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=41475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:23.661118 15325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:23.661372 15325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:17:23.670970 15356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:23.670982 15353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:23.671016 15325 server_base.cc:1034] running on GCE node
W20260812 01:17:23.670982 15362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:23.671548 15325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:23.671882 15325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:23.673024 15325 hybrid_clock.cc:648] HybridClock initialized: now 1786497443673009 us; error 30 us; skew 500 ppm
Aug 12 01:17:23 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:23.675400 15325 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:17:23.675881 15325 webserver.cc:460] Webserver started at http://127.17.183.190:41475/ using document root <none> and password file <none>
I20260812 01:17:23.676133 15325 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:23.676218 15325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:23.677662 15325 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:17:23.678318 15374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:23.678479 15325 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:17:23.678583 15325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "e539f563444c4ab3a61a7d7a991ef406"
format_stamp: "Formatted at 2026-08-12 01:17:02 on dist-test-slave-rwrg"
server_key: "5de1846e6aaeedae3d04ff61470aa4aa"
server_key_iv: "6d66e98c7fa320270ab71e2275de81f3"
server_key_version: "encryptionkey@0"
I20260812 01:17:23.678990 15325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:23.694353 15325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:23.696148 15325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:23.696305 15325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:23.700605 15325 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:43815
I20260812 01:17:23.700664 15478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:43815 every 8 connection(s)
I20260812 01:17:23.701056 15325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:17:23.702502 15480 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:17:23.703181 15480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Bootstrap starting.
I20260812 01:17:23.710391 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 15325
I20260812 01:17:23.710757 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:37417
--local_ip_for_outbound_sockets=127.17.183.129
--tserver_master_addrs=127.17.183.190:43815
--webserver_port=45827
--webserver_interface=127.17.183.129
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:17:23.714767 15480 log.cc:824] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Log is configured to *not* fsync() on all Append() calls
I20260812 01:17:23.717499 15480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:17:23.717871 15480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Bootstrap complete.
I20260812 01:17:23.721860 15480 raft_consensus.cc:348] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:23.722244 15480 raft_consensus.cc:729] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e539f563444c4ab3a61a7d7a991ef406, State: Initialized, Role: FOLLOWER
I20260812 01:17:23.722426 15480 consensus_queue.cc:260] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:23.722519 15480 raft_consensus.cc:388] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:17:23.722590 15480 raft_consensus.cc:482] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:17:23.722654 15480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:17:23.724192 15480 raft_consensus.cc:504] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:23.724301 15480 leader_election.cc:302] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e539f563444c4ab3a61a7d7a991ef406; no voters:
I20260812 01:17:23.724472 15480 leader_election.cc:288] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 01:17:23.724581 15488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 01:17:23.724735 15480 sys_catalog.cc:564] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:17:23.724742 15488 raft_consensus.cc:686] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 2 LEADER]: Becoming Leader. State: Replica: e539f563444c4ab3a61a7d7a991ef406, State: Running, Role: LEADER
I20260812 01:17:23.724922 15488 consensus_queue.cc:237] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:23.725200 15489 sys_catalog.cc:455] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e539f563444c4ab3a61a7d7a991ef406" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } } }
I20260812 01:17:23.725211 15492 sys_catalog.cc:455] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e539f563444c4ab3a61a7d7a991ef406. Latest consensus state: current_term: 2 leader_uuid: "e539f563444c4ab3a61a7d7a991ef406" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } } }
I20260812 01:17:23.725289 15489 sys_catalog.cc:458] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: This master's current role is: LEADER
I20260812 01:17:23.725296 15492 sys_catalog.cc:458] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: This master's current role is: LEADER
I20260812 01:17:23.725505 15506 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:17:23.726313 15506 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:17:23.726431 15506 catalog_manager.cc:1259] Loaded cluster ID: 8feed5aec09340b9bfe753779a9edbf4
I20260812 01:17:23.726662 15506 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:17:23.727903 15506 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:17:23.728070 15506 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Loaded TSK: 0
I20260812 01:17:23.744233 15506 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Generated new TSK 1
I20260812 01:17:23.744350 15506 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 01:17:23.804615 15485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:23.804821 15485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:23.804847 15485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:23.806041 15485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:23.806088 15485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:23.806116 15485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:17:23.807723 15485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:37417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=45827
--tserver_master_addrs=127.17.183.190:43815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:23.807972 15485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:23.808215 15485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:17:23.813345 15534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:23.813468 15539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:23.813328 15532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:23.813629 15485 server_base.cc:1034] running on GCE node
I20260812 01:17:23.813884 15485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:23.814189 15485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:23.815392 15485 hybrid_clock.cc:648] HybridClock initialized: now 1786497443815354 us; error 41 us; skew 500 ppm
Aug 12 01:17:23 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:23.818938 15485 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:17:23.819393 15485 webserver.cc:460] Webserver started at http://127.17.183.129:45827/ using document root <none> and password file <none>
I20260812 01:17:23.819614 15485 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:23.819693 15485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:23.821189 15485 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:17:23.821900 15552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:23.822098 15485 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:17:23.822184 15485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "2fa4d5b142714f828ce55731fc3d1ce7"
format_stamp: "Formatted at 2026-08-12 01:17:02 on dist-test-slave-rwrg"
server_key: "dfe5158a8431ceebc1357acebcd8a003"
server_key_iv: "7334f7a532d3b8d6e7daf089be105228"
server_key_version: "encryptionkey@0"
I20260812 01:17:23.822533 15485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:23.842691 15485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:23.845314 15485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:23.845479 15485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:23.845777 15485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:17:23.846330 15565 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 01:17:23.847921 15485 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 01:17:23.848018 15485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 01:17:23.848075 15485 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 01:17:23.849042 15485 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 01:17:23.849095 15485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260812 01:17:23.849150 15565 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Bootstrap starting.
I20260812 01:17:23.857542 15485 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:37417
I20260812 01:17:23.857672 15785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:37417 every 8 connection(s)
I20260812 01:17:23.858006 15485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:17:23.860456 15565 log.cc:824] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:17:23.862717 15565 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:17:23.863014 15565 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Bootstrap complete.
I20260812 01:17:23.864008 15565 ts_tablet_manager.cc:1397] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.009s
I20260812 01:17:23.865347 15565 raft_consensus.cc:348] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:23.865646 15565 raft_consensus.cc:729] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa4d5b142714f828ce55731fc3d1ce7, State: Initialized, Role: FOLLOWER
I20260812 01:17:23.865784 15565 consensus_queue.cc:260] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:23.866096 15565 ts_tablet_manager.cc:1428] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
Aug 12 01:17:23 dist-test-slave-rwrg krb5kdc[14225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:17:23.868198 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 15485
I20260812 01:17:23.868544 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:42845
--local_ip_for_outbound_sockets=127.17.183.130
--tserver_master_addrs=127.17.183.190:43815
--webserver_port=46803
--webserver_interface=127.17.183.130
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:17:23.870965 15790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:23.858802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:34593)
0812 01:17:23.859179 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:23.859224 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:23.859849 (+ 625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:23.860629 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:23.860634 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:23.860924 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:17:23.861216 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:23.861223 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:23.862915 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:23.862917 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:23.864152 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:23.864155 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:23.865029 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:23.865039 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:23.865219 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:23.865894 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:17:23.865905 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:17:23.867399 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:17:23.869364 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:23.869371 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:23.869373 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:23.869602 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:23.869874 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:23.869875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:23.869875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:23.869984 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:23.870346 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:17:23.870352 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:17:23.870489 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 01:17:23.870597 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 01:17:23.870773 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":91,"threads_started":1}
I20260812 01:17:23.870965 15791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:23.858915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:34593 (local address 127.17.183.190:43815)
0812 01:17:23.860086 (+ 1171us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:23.860096 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:23.860137 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:17:23.860276 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:23.860282 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:23.860337 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:23.860472 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:23.861339 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:23.862745 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:23.864240 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:23.864896 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:23.865012 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:23.867510 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:23.867514 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:23.867514 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:23.867531 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:23.869243 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:23.869698 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:23.869701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:23.869701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:23.869796 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:23.870057 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:23.870058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:23.870058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:23.870276 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:23.870366 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:23.870657 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 01:17:23.870785 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1103,"thread_start_us":97,"threads_started":1}
I20260812 01:17:23.871628 15787 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43815
I20260812 01:17:23.871742 15787 heartbeater.cc:464] Registering TS with master...
I20260812 01:17:23.871912 15787 heartbeater.cc:511] Master 127.17.183.190:43815 requested a full tablet report, sending...
I20260812 01:17:23.872685 15409 ts_manager.cc:194] Registered new tserver with Master: 2fa4d5b142714f828ce55731fc3d1ce7 (127.17.183.129:37417)
I20260812 01:17:23.873783 15409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:34593
I20260812 01:17:23.874913 15787 heartbeater.cc:503] Master 127.17.183.190:43815 was elected leader, sending a full tablet report...
Aug 12 01:17:23 dist-test-slave-rwrg krb5kdc[14225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.129@KRBTEST.COM
I20260812 01:17:23.881255 15800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:23.873420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60048 (local address 127.17.183.129:37417)
0812 01:17:23.873590 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:23.873594 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:23.873836 (+ 242us) server_negotiation.cc:407] Connection header received
0812 01:17:23.874012 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:23.874015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:23.874032 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:23.874101 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:23.874542 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:23.875330 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:23.876040 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:23.876375 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:23.876450 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:23.878496 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:23.878504 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:23.878504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:23.878510 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:23.880027 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:23.880471 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:23.880473 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:23.880473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:23.880567 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:23.880756 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:23.880756 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:23.880757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:23.880881 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:23.880942 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:23.881126 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 01:17:23.881196 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":79,"threads_started":1}
I20260812 01:17:23.881294 15799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:23.873326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:37417 (local address 127.0.0.1:60048)
0812 01:17:23.873680 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:23.873730 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:23.873837 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:23.874120 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:23.874124 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:23.874418 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:17:23.874461 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:23.874463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:23.875397 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:23.875398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:23.875957 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:23.875959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:23.876462 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:23.876464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:23.876565 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:23.877012 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:17:23.877022 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:17:23.878405 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:17:23.880111 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:23.880118 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:23.880120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:23.880386 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:23.880625 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:23.880626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:23.880627 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:23.880693 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:23.880942 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:17:23.880949 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:17:23.881000 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 01:17:23.881084 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 01:17:23.881195 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":78,"threads_started":1}
I20260812 01:17:23.881805 15663 tablet_service.cc:1514] Processing DeleteTablet for tablet 1142777ceb7f4314abf1da8ed69f1b0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:17:03 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:60048
I20260812 01:17:23.882304 15803 tablet_replica.cc:330] stopping tablet replica
I20260812 01:17:23.882417 15803 raft_consensus.cc:2229] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:17:23.882485 15803 raft_consensus.cc:2258] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:17:23.882839 15803 ts_tablet_manager.cc:1905] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:17:23.885069 15803 ts_tablet_manager.cc:1918] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:17:23.885144 15803 log.cc:1196] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal/wals/1142777ceb7f4314abf1da8ed69f1b0f
I20260812 01:17:23.885373 15803 ts_tablet_manager.cc:1939] T 1142777ceb7f4314abf1da8ed69f1b0f P 2fa4d5b142714f828ce55731fc3d1ce7: Deleting consensus metadata
I20260812 01:17:23.885989 15376 catalog_manager.cc:4841] TS 2fa4d5b142714f828ce55731fc3d1ce7 (127.17.183.129:37417): tablet 1142777ceb7f4314abf1da8ed69f1b0f (table test-table [id=0642a7f0779f4493a48578df15a89ae6]) successfully deleted
W20260812 01:17:23.956621 15798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:23.956816 15798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:23.956840 15798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:23.957944 15798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:23.957979 15798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:23.958004 15798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:17:23.959367 15798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:42845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=46803
--tserver_master_addrs=127.17.183.190:43815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:23.959546 15798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:23.959719 15798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 01:17:23.964906 15798 server_base.cc:1034] running on GCE node
W20260812 01:17:23.964918 15811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:23.964877 15818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:23.964877 15814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:23.965385 15798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:23.965631 15798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:23.966804 15798 hybrid_clock.cc:648] HybridClock initialized: now 1786497443966794 us; error 33 us; skew 500 ppm
Aug 12 01:17:23 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:23.969224 15798 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:17:23.969728 15798 webserver.cc:460] Webserver started at http://127.17.183.130:46803/ using document root <none> and password file <none>
I20260812 01:17:23.969957 15798 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:23.970036 15798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:23.971323 15798 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:17:23.972048 15838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:23.972223 15798 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:17:23.972332 15798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "d6d7070d32194e3691b9484dc2aca5e2"
format_stamp: "Formatted at 2026-08-12 01:17:03 on dist-test-slave-rwrg"
server_key: "3805c15208bb71bca066f65435dc7073"
server_key_iv: "2a3f256950ceb5d403a5fe6c621d0997"
server_key_version: "encryptionkey@0"
I20260812 01:17:23.972745 15798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:23.990253 15798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:23.992040 15798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:23.992200 15798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:23.992442 15798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:17:23.992890 15856 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 01:17:23.994385 15798 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 01:17:23.994444 15798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 01:17:23.994486 15798 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 01:17:23.995150 15798 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 01:17:23.995204 15798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 01:17:23.995378 15856 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Bootstrap starting.
I20260812 01:17:23.997160 15856 log.cc:824] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Log is configured to *not* fsync() on all Append() calls
I20260812 01:17:23.999620 15856 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:17:23.999939 15856 tablet_bootstrap.cc:492] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Bootstrap complete.
I20260812 01:17:24.000123 15856 ts_tablet_manager.cc:1397] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 01:17:24.001577 15856 raft_consensus.cc:348] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:24.001858 15856 raft_consensus.cc:729] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d7070d32194e3691b9484dc2aca5e2, State: Initialized, Role: FOLLOWER
I20260812 01:17:24.002041 15856 consensus_queue.cc:260] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:24.002396 15856 ts_tablet_manager.cc:1428] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 01:17:24.002936 15798 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:42845
I20260812 01:17:24.003051 16074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:42845 every 8 connection(s)
I20260812 01:17:24.003350 15798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:17:24.004773 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 15798
I20260812 01:17:24.005086 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:43181
--local_ip_for_outbound_sockets=127.17.183.131
--tserver_master_addrs=127.17.183.190:43815
--webserver_port=35805
--webserver_interface=127.17.183.131
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:17:24 dist-test-slave-rwrg krb5kdc[14225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:17:24.014508 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.004034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:34083)
0812 01:17:24.004176 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:24.004218 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:24.004374 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:24.004654 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:24.004659 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:24.005075 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:17:24.005348 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.005355 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.006086 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.006087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.007308 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.007311 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.007853 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.007854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.007953 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.008581 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:17:24.008591 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:17:24.010943 (+ 2352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:17:24.013051 (+ 2108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:24.013058 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:24.013060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:24.013282 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:24.013540 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:24.013541 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:24.013541 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:24.013640 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:24.013953 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:17:24.013957 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:17:24.014073 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 01:17:24.014154 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 01:17:24.014353 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":59,"threads_started":1}
I20260812 01:17:24.014504 15791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.004100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:34083 (local address 127.17.183.190:43815)
0812 01:17:24.004186 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:24.004188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:24.004297 (+ 109us) server_negotiation.cc:407] Connection header received
0812 01:17:24.004452 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:24.004453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:24.004467 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:24.004583 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:24.005445 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.005956 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.007401 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.007760 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.007839 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.011048 (+ 3209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:24.011050 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:24.011051 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:24.011060 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:24.012922 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:24.013362 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:24.013363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:24.013363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:24.013438 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:24.013708 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:24.013709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:24.013709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:24.013877 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:24.013974 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:24.014231 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 01:17:24.014346 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 01:17:24.015206 16077 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43815
I20260812 01:17:24.015331 16077 heartbeater.cc:464] Registering TS with master...
I20260812 01:17:24.015554 16077 heartbeater.cc:511] Master 127.17.183.190:43815 requested a full tablet report, sending...
I20260812 01:17:24.016208 15409 ts_manager.cc:194] Registered new tserver with Master: d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845)
I20260812 01:17:24.016940 15409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:34083
Aug 12 01:17:24 dist-test-slave-rwrg krb5kdc[14225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.130@KRBTEST.COM
I20260812 01:17:24.024916 15799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.016585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:42845 (local address 127.0.0.1:49574)
0812 01:17:24.016636 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:24.016647 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:24.016690 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:24.017349 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:24.017350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:24.017518 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:17:24.017560 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.017562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.018919 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.018919 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.019415 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.019416 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.020076 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.020077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.020124 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.020581 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:17:24.020591 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:17:24.021746 (+ 1155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:17:24.023818 (+ 2072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:24.023819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:24.023820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:24.023982 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:24.024229 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:24.024230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:24.024230 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:24.024293 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:24.024630 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:17:24.024630 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:17:24.024667 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 01:17:24.024762 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 01:17:24.024848 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 01:17:24.025051 16084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.016634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49574 (local address 127.17.183.130:42845)
0812 01:17:24.017166 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:24.017171 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:24.017186 (+ 15us) server_negotiation.cc:407] Connection header received
0812 01:17:24.017229 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:24.017231 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:24.017249 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:24.017347 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:24.017656 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.018823 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.019501 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.019985 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.020080 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.021828 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:24.021837 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:24.021837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:24.021845 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:24.023731 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:24.024063 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:24.024066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:24.024067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:24.024153 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:24.024350 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:24.024351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:24.024351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:24.024553 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:24.024654 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:24.024800 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 01:17:24.024902 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":96,"threads_started":1}
I20260812 01:17:24.025449 15933 tablet_service.cc:1514] Processing DeleteTablet for tablet 1142777ceb7f4314abf1da8ed69f1b0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:17:03 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:49574
I20260812 01:17:24.026222 16086 tablet_replica.cc:330] stopping tablet replica
I20260812 01:17:24.026346 16086 raft_consensus.cc:2229] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:17:24.026458 16086 raft_consensus.cc:2258] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:17:24.026861 16086 ts_tablet_manager.cc:1905] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:17:24.029346 16086 ts_tablet_manager.cc:1918] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:17:24.029433 16086 log.cc:1196] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/1142777ceb7f4314abf1da8ed69f1b0f
I20260812 01:17:24.029718 16086 ts_tablet_manager.cc:1939] T 1142777ceb7f4314abf1da8ed69f1b0f P d6d7070d32194e3691b9484dc2aca5e2: Deleting consensus metadata
I20260812 01:17:24.030248 15376 catalog_manager.cc:4841] TS d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845): tablet 1142777ceb7f4314abf1da8ed69f1b0f (table test-table [id=0642a7f0779f4493a48578df15a89ae6]) successfully deleted
W20260812 01:17:24.098846 16083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:24.099082 16083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:24.099120 16083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:24.100222 16083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:24.100281 16083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:24.100323 16083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:17:24.101755 16083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:43181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=35805
--tserver_master_addrs=127.17.183.190:43815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:24.102006 16083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:24.102200 16083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:17:24.107209 16098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:24.107316 16083 server_base.cc:1034] running on GCE node
W20260812 01:17:24.107178 16101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:24.107157 16099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:24.107620 16083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:24.107828 16083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:24.108965 16083 hybrid_clock.cc:648] HybridClock initialized: now 1786497444108951 us; error 29 us; skew 500 ppm
Aug 12 01:17:24 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497444, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:24.111399 16083 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:17:24.111835 16083 webserver.cc:460] Webserver started at http://127.17.183.131:35805/ using document root <none> and password file <none>
I20260812 01:17:24.112076 16083 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:24.112161 16083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:24.113519 16083 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:17:24.114096 16112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:24.114262 16083 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:17:24.114365 16083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "5576cbd093d941aeb3259887c2535ea7"
format_stamp: "Formatted at 2026-08-12 01:17:03 on dist-test-slave-rwrg"
server_key: "ec07bb6f6c8f5ee3aa581fe840554889"
server_key_iv: "a74ee71f4844e035cc8e4270ea9a40b0"
server_key_version: "encryptionkey@0"
I20260812 01:17:24.114730 16083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:24.125061 16083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:24.127830 16083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:24.127976 16083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:24.128181 16083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:17:24.128469 16083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:17:24.128539 16083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:24.128573 16083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:17:24.128597 16083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:24.134655 16083 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:43181
I20260812 01:17:24.134750 16340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:43181 every 8 connection(s)
I20260812 01:17:24.135056 16083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
Aug 12 01:17:24 dist-test-slave-rwrg krb5kdc[14225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497444, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:17:24.142522 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 16083
I20260812 01:17:24.143965 15791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.135748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:59923 (local address 127.17.183.190:43815)
0812 01:17:24.135791 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:24.135793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:24.135995 (+ 202us) server_negotiation.cc:407] Connection header received
0812 01:17:24.136526 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:24.136528 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:24.136540 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:24.136595 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:24.137490 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.137976 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.138944 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.139154 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.139234 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.141162 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:24.141164 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:24.141164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:24.141172 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:24.142386 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:24.142877 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:24.142879 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:24.142879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:24.142948 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:24.143252 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:24.143254 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:24.143254 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:24.143408 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:24.143467 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:24.143830 (+ 363us) server_negotiation.cc:299] Negotiation successful
0812 01:17:24.143901 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:17:24.144198 16343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.135733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:59923)
0812 01:17:24.135884 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:24.135918 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:24.136399 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:24.136663 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:24.136666 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:24.137207 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:17:24.137386 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.137390 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.138068 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.138070 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.138857 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.138858 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.139248 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.139249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.139364 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.139761 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:17:24.139769 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:17:24.141074 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:17:24.142483 (+ 1409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:24.142490 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:24.142491 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:24.142792 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:24.143025 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:24.143026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:24.143027 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:24.143179 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:24.143479 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:17:24.143486 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:17:24.143682 (+ 196us) client_negotiation.cc:769] Sending connection context
0812 01:17:24.143814 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 01:17:24.143979 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":85,"threads_started":1}
I20260812 01:17:24.144763 16341 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43815
I20260812 01:17:24.144877 16341 heartbeater.cc:464] Registering TS with master...
I20260812 01:17:24.145053 16341 heartbeater.cc:511] Master 127.17.183.190:43815 requested a full tablet report, sending...
I20260812 01:17:24.145458 15409 ts_manager.cc:194] Registered new tserver with Master: 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181)
I20260812 01:17:24.145977 15409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:59923
I20260812 01:17:24.149734 16345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.142964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47994 (local address 127.17.183.190:43815)
0812 01:17:24.143096 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:24.143098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:24.143184 (+ 86us) server_negotiation.cc:407] Connection header received
0812 01:17:24.143248 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:24.143248 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:24.143261 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:24.143333 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:24.144071 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.144718 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.145542 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.145840 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.145900 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.147123 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:24.147124 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:24.147125 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:24.147132 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:24.148616 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:24.148956 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:24.148957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:24.148957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:24.149011 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:24.149210 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:24.149211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:24.149211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:24.149327 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:24.149482 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:24.149546 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 01:17:24.149632 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260812 01:17:24.150357 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:17:24.153121 16345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.150628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48006 (local address 127.17.183.190:43815)
0812 01:17:24.150700 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:24.150702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:24.150791 (+ 89us) server_negotiation.cc:407] Connection header received
0812 01:17:24.150874 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:24.150875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:24.150905 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:24.150983 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:17:24.151095 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.151527 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.152266 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.152474 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.152583 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.152757 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:17:24.152801 (+ 44us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 01:17:24.153061 (+ 260us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48006: token expired
Metrics: {"server-negotiator.queue_time_us":36}
W20260812 01:17:24.153162 16345 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48006: token expired
W20260812 01:17:24.153777 15245 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.17.183.190:43815)
I20260812 01:17:24.159190 16345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.154011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48008 (local address 127.17.183.190:43815)
0812 01:17:24.154071 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:24.154073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:24.154118 (+ 45us) server_negotiation.cc:407] Connection header received
0812 01:17:24.154168 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:24.154169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:24.154176 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:24.154213 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:24.154608 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.155039 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.155670 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.155843 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.155891 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.157062 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:24.157063 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:24.157063 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:24.157069 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:24.158319 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:24.158614 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:24.158615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:24.158615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:24.158664 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:24.158816 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:24.158816 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:24.158817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:24.158907 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:24.158980 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:24.159055 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 01:17:24.159111 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 01:17:24.160351 15409 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:17:24.162051 15409 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:17:24.164117 15933 tablet_service.cc:1467] Processing CreateTablet for tablet 21ee4345496a4409b900fa77c672f2b8 (DEFAULT_TABLE table=test-table [id=143d4f72110945f7b405699a06fc415a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:17:24.164330 15933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21ee4345496a4409b900fa77c672f2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:17:24.164304 15663 tablet_service.cc:1467] Processing CreateTablet for tablet 21ee4345496a4409b900fa77c672f2b8 (DEFAULT_TABLE table=test-table [id=143d4f72110945f7b405699a06fc415a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:17:24.164510 15663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21ee4345496a4409b900fa77c672f2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:17:24.165954 15565 tablet_bootstrap.cc:492] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: Bootstrap starting.
I20260812 01:17:24.166035 15856 tablet_bootstrap.cc:492] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2: Bootstrap starting.
I20260812 01:17:24.166280 15565 tablet_bootstrap.cc:654] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: Neither blocks nor log segments found. Creating new log.
I20260812 01:17:24.166460 15856 tablet_bootstrap.cc:654] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2: Neither blocks nor log segments found. Creating new log.
I20260812 01:17:24.166756 15565 tablet_bootstrap.cc:492] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: No bootstrap required, opened a new log
I20260812 01:17:24.166813 15565 ts_tablet_manager.cc:1397] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 01:17:24.167184 15856 tablet_bootstrap.cc:492] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2: No bootstrap required, opened a new log
I20260812 01:17:24.167204 15565 raft_consensus.cc:348] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:24.167261 15856 ts_tablet_manager.cc:1397] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:17:24.167316 15565 raft_consensus.cc:374] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:17:24.167373 15565 raft_consensus.cc:729] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa4d5b142714f828ce55731fc3d1ce7, State: Initialized, Role: FOLLOWER
I20260812 01:17:24.167428 15565 consensus_queue.cc:260] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:24.167520 15565 ts_tablet_manager.cc:1428] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 01:17:24.167579 15856 raft_consensus.cc:348] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:24.167661 15856 raft_consensus.cc:374] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:17:24.167703 15856 raft_consensus.cc:729] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d7070d32194e3691b9484dc2aca5e2, State: Initialized, Role: FOLLOWER
I20260812 01:17:24.167752 15856 consensus_queue.cc:260] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:24.167850 15856 ts_tablet_manager.cc:1428] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 01:17:24.167905 16077 heartbeater.cc:503] Master 127.17.183.190:43815 was elected leader, sending a full tablet report...
I20260812 01:17:24.168998 15799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.163868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:43181 (local address 127.0.0.1:58236)
0812 01:17:24.163913 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:24.163924 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:24.163960 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:24.164334 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:24.164336 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:24.164337 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:17:24.164378 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.164379 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.165552 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.165553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.166715 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.166719 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.168729 (+ 2010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.168731 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.168792 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.168817 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 01:17:24.168882 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 01:17:24.168925 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 01:17:24.169023 16350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.163970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58236 (local address 127.17.183.131:43181)
0812 01:17:24.164161 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:24.164165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:24.164176 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:17:24.164217 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:24.164219 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:24.164234 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:24.164321 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:17:24.164444 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.165457 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.167627 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.168655 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.168733 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.168794 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:24.168897 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 01:17:24.168937 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":120,"threads_started":1}
I20260812 01:17:24.169695 16209 tablet_service.cc:1467] Processing CreateTablet for tablet 21ee4345496a4409b900fa77c672f2b8 (DEFAULT_TABLE table=test-table [id=143d4f72110945f7b405699a06fc415a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:17:24.169981 16209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21ee4345496a4409b900fa77c672f2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:17:24.172751 16362 tablet_bootstrap.cc:492] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: Bootstrap starting.
I20260812 01:17:24.173359 16362 tablet_bootstrap.cc:654] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: Neither blocks nor log segments found. Creating new log.
I20260812 01:17:24.173856 16362 log.cc:824] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:17:24.174542 16362 tablet_bootstrap.cc:492] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: No bootstrap required, opened a new log
I20260812 01:17:24.174595 16362 ts_tablet_manager.cc:1397] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:17:24.176100 16362 raft_consensus.cc:348] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:24.176246 16362 raft_consensus.cc:374] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:17:24.176299 16362 raft_consensus.cc:729] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5576cbd093d941aeb3259887c2535ea7, State: Initialized, Role: FOLLOWER
I20260812 01:17:24.176431 16362 consensus_queue.cc:260] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:24.176725 16362 ts_tablet_manager.cc:1428] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:17:24.176774 16341 heartbeater.cc:503] Master 127.17.183.190:43815 was elected leader, sending a full tablet report...
W20260812 01:17:24.254048 16079 tablet.cc:2369] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:17:24.358817 15789 tablet.cc:2369] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:17:24.368335 15796 raft_consensus.cc:482] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:17:24.368449 15796 raft_consensus.cc:504] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:24.368834 15796 leader_election.cc:288] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181), d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845)
I20260812 01:17:24.371730 16350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.369259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:37353 (local address 127.17.183.131:43181)
0812 01:17:24.369309 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:24.369311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:24.369338 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:17:24.369368 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:24.369370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:24.369379 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:24.369426 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:17:24.369580 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.370058 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.370986 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.371373 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.371458 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.371467 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:24.371620 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 01:17:24.371658 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 01:17:24.371758 15790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.369122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:43181 (local address 127.17.183.129:37353)
0812 01:17:24.369193 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:24.369209 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:24.369286 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:24.369443 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:24.369444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:24.369446 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:17:24.369502 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.369504 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.370142 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.370144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.370891 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.370893 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.371458 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.371459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.371527 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.371546 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 01:17:24.371614 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 01:17:24.371656 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":1}
I20260812 01:17:24.372125 16242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ee4345496a4409b900fa77c672f2b8" candidate_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5576cbd093d941aeb3259887c2535ea7" is_pre_election: true
I20260812 01:17:24.372292 16242 raft_consensus.cc:2454] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa4d5b142714f828ce55731fc3d1ce7 in term 0.
I20260812 01:17:24.372575 16084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.369216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:43201 (local address 127.17.183.130:42845)
0812 01:17:24.369292 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:24.369294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:24.369396 (+ 102us) server_negotiation.cc:407] Connection header received
0812 01:17:24.369500 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:24.369501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:24.369531 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:24.369618 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:17:24.369805 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.370426 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.371562 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.372116 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.372227 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.372306 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:24.372397 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 01:17:24.372438 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:17:24.372612 16370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.369126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:42845 (local address 127.17.183.129:43201)
0812 01:17:24.369303 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:24.369315 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:24.369415 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:24.369621 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:24.369622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:24.369624 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:17:24.369721 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.369723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.370530 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.370531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.371448 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:24.371451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.372229 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.372230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:24.372317 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.372322 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:17:24.372390 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 01:17:24.372435 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":22,"thread_start_us":71,"threads_started":1}
I20260812 01:17:24.372579 15558 leader_election.cc:302] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa4d5b142714f828ce55731fc3d1ce7, 5576cbd093d941aeb3259887c2535ea7; no voters:
I20260812 01:17:24.372732 15796 raft_consensus.cc:2781] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:17:24.372797 15796 raft_consensus.cc:482] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:17:24.372819 15796 raft_consensus.cc:3037] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:17:24.372931 15967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ee4345496a4409b900fa77c672f2b8" candidate_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d7070d32194e3691b9484dc2aca5e2" is_pre_election: true
I20260812 01:17:24.373122 15967 raft_consensus.cc:2454] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa4d5b142714f828ce55731fc3d1ce7 in term 0.
I20260812 01:17:24.373667 15796 raft_consensus.cc:504] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:24.373814 15796 leader_election.cc:288] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 1 election: Requested vote from peers 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181), d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845)
I20260812 01:17:24.373997 15967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ee4345496a4409b900fa77c672f2b8" candidate_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d7070d32194e3691b9484dc2aca5e2"
I20260812 01:17:24.374064 15967 raft_consensus.cc:3037] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:17:24.374838 15967 raft_consensus.cc:2454] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa4d5b142714f828ce55731fc3d1ce7 in term 1.
I20260812 01:17:24.374998 16242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ee4345496a4409b900fa77c672f2b8" candidate_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5576cbd093d941aeb3259887c2535ea7"
I20260812 01:17:24.375089 15553 leader_election.cc:302] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa4d5b142714f828ce55731fc3d1ce7, d6d7070d32194e3691b9484dc2aca5e2; no voters:
I20260812 01:17:24.375093 16242 raft_consensus.cc:3037] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:17:24.375212 15796 raft_consensus.cc:2781] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:17:24.375422 15796 raft_consensus.cc:686] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa4d5b142714f828ce55731fc3d1ce7, State: Running, Role: LEADER
I20260812 01:17:24.375497 15796 consensus_queue.cc:237] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:24.376143 16242 raft_consensus.cc:2454] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa4d5b142714f828ce55731fc3d1ce7 in term 1.
I20260812 01:17:24.376384 15408 catalog_manager.cc:5495] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa4d5b142714f828ce55731fc3d1ce7 (127.17.183.129). New cstate: current_term: 1 leader_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } health_report { overall_health: UNKNOWN } } }
W20260812 01:17:24.385598 16342 tablet.cc:2369] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:17:24.393328 16374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.390943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42846 (local address 127.17.183.129:37417)
0812 01:17:24.391056 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:24.391057 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:24.391065 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:17:24.391114 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:24.391116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:24.391134 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:24.391228 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:17:24.391351 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.391822 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.392585 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:24.392783 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:24.392847 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:24.393005 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:17:24.393101 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:17:24.393161 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:24.393193 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 01:17:24.393211 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":54,"threads_started":1}
I20260812 01:17:24.394742 15967 raft_consensus.cc:1261] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Refusing update from remote peer 2fa4d5b142714f828ce55731fc3d1ce7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:17:24.394774 16242 raft_consensus.cc:1261] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7 [term 1 FOLLOWER]: Refusing update from remote peer 2fa4d5b142714f828ce55731fc3d1ce7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:17:24.395107 15796 consensus_queue.cc:1035] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:17:24.395259 16371 consensus_queue.cc:1035] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:17:24.397466 16376 mvcc.cc:205] Tried to move back new op lower bound from 7317493532238471168 to 7317493532162805760. Current Snapshot: MvccSnapshot[applied={T|T < 7317493532238471168}]
I20260812 01:17:24.397601 16379 mvcc.cc:205] Tried to move back new op lower bound from 7317493532238471168 to 7317493532162805760. Current Snapshot: MvccSnapshot[applied={T|T < 7317493532238471168}]
I20260812 01:17:24.399679 15409 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:17:24.399767 15409 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:17:24.400990 15409 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Sending DeleteTablet for 3 replicas of tablet 21ee4345496a4409b900fa77c672f2b8
I20260812 01:17:24.401335 15663 tablet_service.cc:1514] Processing DeleteTablet for tablet 21ee4345496a4409b900fa77c672f2b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:17:24 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:60048
I20260812 01:17:24.401368 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 15485
I20260812 01:17:24.401350 16209 tablet_service.cc:1514] Processing DeleteTablet for tablet 21ee4345496a4409b900fa77c672f2b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:17:24 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:58236
I20260812 01:17:24.401556 15933 tablet_service.cc:1514] Processing DeleteTablet for tablet 21ee4345496a4409b900fa77c672f2b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:17:24 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:49574
I20260812 01:17:24.410157 16403 tablet_replica.cc:330] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: stopping tablet replica
I20260812 01:17:24.410259 16403 raft_consensus.cc:2229] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:17:24.410295 16086 tablet_replica.cc:330] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2: stopping tablet replica
I20260812 01:17:24.410339 16403 raft_consensus.cc:2258] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:17:24.410375 16086 raft_consensus.cc:2229] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:17:24.410429 16086 raft_consensus.cc:2258] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:17:24.410939 16086 ts_tablet_manager.cc:1905] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:17:24.410948 16403 ts_tablet_manager.cc:1905] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:17:24.412688 16086 ts_tablet_manager.cc:1918] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:17:24.412760 16086 log.cc:1196] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/21ee4345496a4409b900fa77c672f2b8
I20260812 01:17:24.412976 16086 ts_tablet_manager.cc:1939] T 21ee4345496a4409b900fa77c672f2b8 P d6d7070d32194e3691b9484dc2aca5e2: Deleting consensus metadata
I20260812 01:17:24.413262 16403 ts_tablet_manager.cc:1918] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:17:24.413342 16403 log.cc:1196] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/21ee4345496a4409b900fa77c672f2b8
I20260812 01:17:24.413329 15376 catalog_manager.cc:4841] TS d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845): tablet 21ee4345496a4409b900fa77c672f2b8 (table test-table [id=143d4f72110945f7b405699a06fc415a]) successfully deleted
I20260812 01:17:24.413646 16403 ts_tablet_manager.cc:1939] T 21ee4345496a4409b900fa77c672f2b8 P 5576cbd093d941aeb3259887c2535ea7: Deleting consensus metadata
I20260812 01:17:24.414235 15387 catalog_manager.cc:4841] TS 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181): tablet 21ee4345496a4409b900fa77c672f2b8 (table test-table [id=143d4f72110945f7b405699a06fc415a]) successfully deleted
W20260812 01:17:24.418373 15376 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:37417 (error 108)
I20260812 01:17:24.418619 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 15798
I20260812 01:17:24.418879 15799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:24.418756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:37417 (local address 127.0.0.1:42860)
0812 01:17:24.418804 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:24.418840 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:37417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 01:17:24.418982 15376 catalog_manager.cc:4584] TS 2fa4d5b142714f828ce55731fc3d1ce7 (127.17.183.129:37417): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 21ee4345496a4409b900fa77c672f2b8: Network error: Client connection negotiation failed: client connection to 127.17.183.129:37417: connect: Connection refused (error 111)
I20260812 01:17:24.437937 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 16083
I20260812 01:17:24.455663 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 15325
I20260812 01:17:44.471792 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43815
--webserver_interface=127.17.183.190
--webserver_port=41475
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:43815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:17:44.558622 16406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:44.558902 16406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:44.558944 16406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:44.560094 16406 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 01:17:44.560164 16406 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 01:17:44.560187 16406 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 01:17:44.560207 16406 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:17:44.560233 16406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:44.560262 16406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:44.560289 16406 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:17:44.560319 16406 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:17:44.561801 16406 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:43815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=41475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:44.562093 16406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:44.562335 16406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:17:44.567857 16413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:44.568045 16415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:44.567883 16418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:44.567914 16406 server_base.cc:1034] running on GCE node
I20260812 01:17:44.568370 16406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:44.568692 16406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:44.569883 16406 hybrid_clock.cc:648] HybridClock initialized: now 1786497464569878 us; error 40 us; skew 500 ppm
Aug 12 01:17:44 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:44.572379 16406 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:17:44.572877 16406 webserver.cc:460] Webserver started at http://127.17.183.190:41475/ using document root <none> and password file <none>
I20260812 01:17:44.573137 16406 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:44.573220 16406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:44.574620 16406 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:17:44.575297 16427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:44.575524 16406 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:17:44.575639 16406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "e539f563444c4ab3a61a7d7a991ef406"
format_stamp: "Formatted at 2026-08-12 01:17:02 on dist-test-slave-rwrg"
server_key: "5de1846e6aaeedae3d04ff61470aa4aa"
server_key_iv: "6d66e98c7fa320270ab71e2275de81f3"
server_key_version: "encryptionkey@0"
I20260812 01:17:44.575979 16406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:44.592811 16406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:44.594702 16406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:44.594873 16406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:44.599270 16406 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:43815
I20260812 01:17:44.599308 16544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:43815 every 8 connection(s)
I20260812 01:17:44.599762 16406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:17:44.601292 16545 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:17:44.602036 16545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Bootstrap starting.
I20260812 01:17:44.608570 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 16406
I20260812 01:17:44.608968 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:37417
--local_ip_for_outbound_sockets=127.17.183.129
--tserver_master_addrs=127.17.183.190:43815
--webserver_port=45827
--webserver_interface=127.17.183.129
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:17:44.612253 16545 log.cc:824] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Log is configured to *not* fsync() on all Append() calls
I20260812 01:17:44.614770 16545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:17:44.615124 16545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Bootstrap complete.
I20260812 01:17:44.617517 16545 raft_consensus.cc:348] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:44.617832 16545 raft_consensus.cc:729] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e539f563444c4ab3a61a7d7a991ef406, State: Initialized, Role: FOLLOWER
I20260812 01:17:44.618105 16545 consensus_queue.cc:260] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:44.618217 16545 raft_consensus.cc:388] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:17:44.618275 16545 raft_consensus.cc:482] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:17:44.618325 16545 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 2 FOLLOWER]: Advancing to term 3
I20260812 01:17:44.619329 16545 raft_consensus.cc:504] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:44.619465 16545 leader_election.cc:302] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e539f563444c4ab3a61a7d7a991ef406; no voters:
I20260812 01:17:44.619668 16545 leader_election.cc:288] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 01:17:44.619755 16552 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 01:17:44.619941 16552 raft_consensus.cc:686] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [term 3 LEADER]: Becoming Leader. State: Replica: e539f563444c4ab3a61a7d7a991ef406, State: Running, Role: LEADER
I20260812 01:17:44.619961 16545 sys_catalog.cc:564] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:17:44.620064 16552 consensus_queue.cc:237] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } }
I20260812 01:17:44.620388 16552 sys_catalog.cc:455] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e539f563444c4ab3a61a7d7a991ef406. Latest consensus state: current_term: 3 leader_uuid: "e539f563444c4ab3a61a7d7a991ef406" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } } }
I20260812 01:17:44.620532 16552 sys_catalog.cc:458] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: This master's current role is: LEADER
I20260812 01:17:44.620388 16553 sys_catalog.cc:455] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e539f563444c4ab3a61a7d7a991ef406" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e539f563444c4ab3a61a7d7a991ef406" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43815 } } }
I20260812 01:17:44.620862 16553 sys_catalog.cc:458] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406 [sys.catalog]: This master's current role is: LEADER
I20260812 01:17:44.621038 16574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:17:44.621856 16574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:17:44.621960 16574 catalog_manager.cc:1259] Loaded cluster ID: 8feed5aec09340b9bfe753779a9edbf4
I20260812 01:17:44.621999 16574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:17:44.623322 16574 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:17:44.623497 16574 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Loaded TSK: 0
I20260812 01:17:44.623551 16574 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e539f563444c4ab3a61a7d7a991ef406: Loaded TSK: 1
F20260812 01:17:44.623782 16574 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f9c245879ad google::LogMessage::Fail() at ??:0
@ 0x7f9c2458a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f9c245874de google::LogMessage::Flush() at ??:0
@ 0x7f9c24588a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9c26cf4104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f9c26cf1d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f9c2c4e11cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f9c2c4e148e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f9c2c4e1594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f9c2c4a7c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f9c2c4b1ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9c264550d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9c2644a954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9c272ae6db start_thread at ??:0
@ 0x7f9c2308561f clone at ??:0
W20260812 01:17:44.716889 16548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:44.717095 16548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:44.717119 16548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:44.718289 16548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:44.718334 16548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:44.718361 16548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:17:44.719826 16548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:37417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=45827
--tserver_master_addrs=127.17.183.190:43815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:44.720077 16548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:44.720332 16548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:17:44.727049 16633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:44.727010 16635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:44.727207 16548 server_base.cc:1034] running on GCE node
W20260812 01:17:44.727290 16631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:44.727617 16548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:44.727916 16548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:44.729079 16548 hybrid_clock.cc:648] HybridClock initialized: now 1786497464729065 us; error 27 us; skew 500 ppm
Aug 12 01:17:44 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:44.731813 16548 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:17:44.732316 16548 webserver.cc:460] Webserver started at http://127.17.183.129:45827/ using document root <none> and password file <none>
I20260812 01:17:44.732610 16548 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:44.732692 16548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:44.734171 16548 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:17:44.735044 16653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:44.735306 16548 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:17:44.735420 16548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "2fa4d5b142714f828ce55731fc3d1ce7"
format_stamp: "Formatted at 2026-08-12 01:17:02 on dist-test-slave-rwrg"
server_key: "dfe5158a8431ceebc1357acebcd8a003"
server_key_iv: "7334f7a532d3b8d6e7daf089be105228"
server_key_version: "encryptionkey@0"
I20260812 01:17:44.735836 16548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:44.747565 16548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:44.750097 16548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:44.750270 16548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:44.750504 16548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:17:44.751004 16670 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 01:17:44.753111 16548 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 01:17:44.753283 16548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 01:17:44.753329 16548 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 01:17:44.753968 16548 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 01:17:44.754027 16548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 01:17:44.754107 16670 tablet_bootstrap.cc:492] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: Bootstrap starting.
I20260812 01:17:44.761919 16548 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:37417
I20260812 01:17:44.762007 16867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:37417 every 8 connection(s)
I20260812 01:17:44.762429 16548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:17:44.765856 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 16548
I20260812 01:17:44.766202 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:42845
--local_ip_for_outbound_sockets=127.17.183.130
--tserver_master_addrs=127.17.183.190:43815
--webserver_port=46803
--webserver_interface=127.17.183.130
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:17:44.766640 16670 log.cc:824] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:17:44.769368 16670 tablet_bootstrap.cc:492] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:17:44.769665 16670 tablet_bootstrap.cc:492] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: Bootstrap complete.
I20260812 01:17:44.770704 16670 ts_tablet_manager.cc:1397] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.004s
I20260812 01:17:44.771874 16670 raft_consensus.cc:348] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:44.772125 16670 raft_consensus.cc:729] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa4d5b142714f828ce55731fc3d1ce7, State: Initialized, Role: FOLLOWER
I20260812 01:17:44.772294 16670 consensus_queue.cc:260] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:44.772636 16670 ts_tablet_manager.cc:1428] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7: Time spent starting tablet: real 0.002s user 0.001s sys 0.003s
W20260812 01:17:44.850961 16883 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:17:44.763293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:51689)
0812 01:17:44.763534 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:44.763587 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:44.764231 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:44.850709 (+ 86478us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":111,"threads_started":1}
W20260812 01:17:44.851296 16873 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:43815 (0 consecutive failures): Network error: Failed to ping master at 127.17.183.190:43815: Client connection negotiation failed: client connection to 127.17.183.190:43815: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 01:17:44.851722 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:44.851552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:44749)
0812 01:17:44.851656 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:44.851698 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 01:17:44.852150 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:44.852052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:50523)
0812 01:17:44.852109 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:44.852133 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 01:17:44.852294 16873 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 01:17:44.868882 16891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:44.869100 16891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:44.869125 16891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:44.870272 16891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:44.870311 16891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:44.870337 16891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:17:44.871763 16891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:42845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=46803
--tserver_master_addrs=127.17.183.190:43815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:44.871958 16891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:44.872138 16891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:17:44.877595 16907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:44.877624 16891 server_base.cc:1034] running on GCE node
W20260812 01:17:44.877620 16906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:44.877595 16909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:44.878060 16891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:44.878288 16891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:44.879498 16891 hybrid_clock.cc:648] HybridClock initialized: now 1786497464879478 us; error 34 us; skew 500 ppm
Aug 12 01:17:44 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:44.882231 16891 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:17:44.882685 16891 webserver.cc:460] Webserver started at http://127.17.183.130:46803/ using document root <none> and password file <none>
I20260812 01:17:44.882938 16891 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:44.883021 16891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:44.884429 16891 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:17:44.885124 16926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:44.885317 16891 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 01:17:44.885433 16891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "d6d7070d32194e3691b9484dc2aca5e2"
format_stamp: "Formatted at 2026-08-12 01:17:03 on dist-test-slave-rwrg"
server_key: "3805c15208bb71bca066f65435dc7073"
server_key_iv: "2a3f256950ceb5d403a5fe6c621d0997"
server_key_version: "encryptionkey@0"
I20260812 01:17:44.885788 16891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:44.897759 16891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:44.899746 16891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:44.899931 16891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:44.900189 16891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:17:44.900542 16891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:17:44.900609 16891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:44.900653 16891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:17:44.900701 16891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:44.907464 16891 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:42845
I20260812 01:17:44.907531 17138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:42845 every 8 connection(s)
I20260812 01:17:44.907897 16891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:17:44.909142 17147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:44.908698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:34979)
0812 01:17:44.908890 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:44.908971 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":86,"threads_started":1}
W20260812 01:17:44.909595 17141 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:43815 (0 consecutive failures): Network error: Failed to ping master at 127.17.183.190:43815: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
I20260812 01:17:44.909960 17147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:44.909823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:55243)
0812 01:17:44.909901 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:44.909935 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 01:17:44.910372 17147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:44.910267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:47717)
0812 01:17:44.910321 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:44.910353 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 01:17:44.910485 17141 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 01:17:44.915120 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 16891
I20260812 01:17:44.915439 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:43181
--local_ip_for_outbound_sockets=127.17.183.131
--tserver_master_addrs=127.17.183.190:43815
--webserver_port=35805
--webserver_interface=127.17.183.131
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:17:45.001649 17148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:17:45.001864 17148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:17:45.001890 17148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:17:45.003080 17148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:17:45.003127 17148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:17:45.003155 17148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:17:45.004784 17148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:43181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=35805
--tserver_master_addrs=127.17.183.190:43815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:17:45.005072 17148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:17:45.005337 17148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:17:45.010744 17157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:45.010717 17156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:17:45.010721 17159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:17:45.011065 17148 server_base.cc:1034] running on GCE node
I20260812 01:17:45.011322 17148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:17:45.011587 17148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:17:45.012748 17148 hybrid_clock.cc:648] HybridClock initialized: now 1786497465012730 us; error 33 us; skew 500 ppm
Aug 12 01:17:45 dist-test-slave-rwrg krb5kdc[14225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:17:45.015503 17148 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:17:45.015961 17148 webserver.cc:460] Webserver started at http://127.17.183.131:35805/ using document root <none> and password file <none>
I20260812 01:17:45.016222 17148 fs_manager.cc:359] Metadata directory not provided
I20260812 01:17:45.016306 17148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:17:45.017706 17148 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:17:45.018325 17172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:45.018512 17148 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:17:45.018623 17148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "5576cbd093d941aeb3259887c2535ea7"
format_stamp: "Formatted at 2026-08-12 01:17:03 on dist-test-slave-rwrg"
server_key: "ec07bb6f6c8f5ee3aa581fe840554889"
server_key_iv: "a74ee71f4844e035cc8e4270ea9a40b0"
server_key_version: "encryptionkey@0"
I20260812 01:17:45.018992 17148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:17:45.027195 17148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:17:45.029385 17148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:17:45.029575 17148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:17:45.029826 17148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:17:45.030190 17148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:17:45.030258 17148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:45.030296 17148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:17:45.030323 17148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:17:45.036692 17148 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:43181
I20260812 01:17:45.036744 17379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:43181 every 8 connection(s)
I20260812 01:17:45.037110 17148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:17:45.038262 17384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:45.037803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:55251)
0812 01:17:45.038025 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:45.038105 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":93,"threads_started":1}
W20260812 01:17:45.038774 17380 heartbeater.cc:644] Failed to heartbeat to 127.17.183.190:43815 (0 consecutive failures): Network error: Failed to ping master at 127.17.183.190:43815: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
I20260812 01:17:45.039132 17384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:45.039035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:59987)
0812 01:17:45.039084 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:45.039113 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 01:17:45.039399 17384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:45.039347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:53363)
0812 01:17:45.039367 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:45.039386 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260812 01:17:45.039529 17380 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 01:17:45.041882 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 17148
I20260812 01:17:45.853004 17387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:45.852756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:54679)
0812 01:17:45.852899 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:45.852938 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":71,"threads_started":1}
I20260812 01:17:45.911175 17392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:45.910838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:45401)
0812 01:17:45.911079 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:45.911120 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":57,"threads_started":1}
I20260812 01:17:46.040123 17393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:46.039891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:57019)
0812 01:17:46.040010 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:46.040049 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260812 01:17:46.141322 17394 raft_consensus.cc:482] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:17:46.141453 17394 raft_consensus.cc:504] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:46.141772 17394 leader_election.cc:288] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181), d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845)
Aug 12 01:17:46 dist-test-slave-rwrg krb5kdc[14225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.131@KRBTEST.COM
Aug 12 01:17:46 dist-test-slave-rwrg krb5kdc[14225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.130@KRBTEST.COM
I20260812 01:17:46.152953 17395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:46.141988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:42845 (local address 127.17.183.129:54461)
0812 01:17:46.142122 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:46.142131 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:46.142170 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:46.143063 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:46.143066 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:46.143469 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:17:46.143671 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:46.143678 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:46.144923 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:46.144924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:46.145684 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:46.145687 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:46.146288 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:46.146289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:46.146405 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:46.147033 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:17:46.147041 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:17:46.148897 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:17:46.151195 (+ 2298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:46.151202 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:46.151205 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:46.151531 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:46.151814 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:46.151815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:46.151815 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:46.151939 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:46.152384 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:17:46.152385 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:17:46.152481 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 01:17:46.152661 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 01:17:46.152849 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":116,"thread_start_us":56,"threads_started":1}
I20260812 01:17:46.152964 17399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:46.142128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:41379 (local address 127.17.183.131:43181)
0812 01:17:46.142315 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:46.142323 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:46.142352 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:17:46.142800 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:46.142802 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:46.142844 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:46.142999 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:46.143826 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:46.144789 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:46.145797 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:46.146186 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:46.146325 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:46.149031 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:46.149043 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:46.149043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:46.149054 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:46.151179 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:46.151642 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:46.151645 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:46.151645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:46.151735 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:46.152017 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:46.152018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:46.152019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:46.152264 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:46.152329 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:46.152722 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 01:17:46.152850 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":68,"threads_started":1}
I20260812 01:17:46.153070 17387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:46.141986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:43181 (local address 127.17.183.129:41379)
0812 01:17:46.142050 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:46.142062 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:17:46.142119 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:17:46.143104 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:17:46.143105 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:17:46.143471 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:17:46.143671 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:46.143678 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:46.144904 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:46.144906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:46.145682 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:17:46.145684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:17:46.146295 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:17:46.146296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:17:46.146405 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:46.147080 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:17:46.147085 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:17:46.148640 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:17:46.151276 (+ 2636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:46.151277 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:46.151277 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:46.151530 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:46.151821 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:17:46.151822 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:17:46.151822 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:17:46.151942 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:17:46.152346 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:17:46.152353 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:17:46.152481 (+ 128us) client_negotiation.cc:769] Sending connection context
0812 01:17:46.152628 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 01:17:46.152938 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":121}
I20260812 01:17:46.153681 17398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:46.142122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:54461 (local address 127.17.183.130:42845)
0812 01:17:46.142296 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:17:46.142307 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:17:46.142339 (+ 32us) server_negotiation.cc:407] Connection header received
0812 01:17:46.142810 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:17:46.142813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:17:46.142850 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:17:46.143023 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:17:46.143828 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:46.144795 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:46.145785 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:17:46.146187 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:17:46.146324 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:17:46.149020 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:17:46.149024 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:17:46.149025 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:17:46.149037 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:17:46.151100 (+ 2063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:46.151629 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:46.151633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:46.151633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:46.151734 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:17:46.152025 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:17:46.152025 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:17:46.152026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:17:46.152277 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:17:46.152382 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 01:17:46.152741 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 01:17:46.152889 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":57,"threads_started":1}
W20260812 01:17:46.153978 16662 leader_election.cc:341] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181): Not found: Tablet not found: 21ee4345496a4409b900fa77c672f2b8
W20260812 01:17:46.154412 16654 leader_election.cc:341] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845): Not found: Tablet not found: 21ee4345496a4409b900fa77c672f2b8
I20260812 01:17:46.154458 16654 leader_election.cc:302] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa4d5b142714f828ce55731fc3d1ce7; no voters: 5576cbd093d941aeb3259887c2535ea7, d6d7070d32194e3691b9484dc2aca5e2
I20260812 01:17:46.154644 17394 raft_consensus.cc:2726] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:17:46.853856 17401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:46.853621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:39585)
0812 01:17:46.853768 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:46.853810 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":71,"threads_started":1}
I20260812 01:17:46.911913 17403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:46.911703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:57559)
0812 01:17:46.911834 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:46.911872 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
I20260812 01:17:47.040872 17407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:47.040650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:60233)
0812 01:17:47.040790 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:47.040832 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":63,"threads_started":1}
I20260812 01:17:47.777904 17412 raft_consensus.cc:482] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:17:47.778005 17412 raft_consensus.cc:504] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:47.778241 17412 leader_election.cc:288] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181), d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845)
W20260812 01:17:47.778726 16662 leader_election.cc:341] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181): Not found: Tablet not found: 21ee4345496a4409b900fa77c672f2b8
W20260812 01:17:47.778797 16654 leader_election.cc:341] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845): Not found: Tablet not found: 21ee4345496a4409b900fa77c672f2b8
I20260812 01:17:47.778861 16662 leader_election.cc:302] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa4d5b142714f828ce55731fc3d1ce7; no voters: 5576cbd093d941aeb3259887c2535ea7, d6d7070d32194e3691b9484dc2aca5e2
I20260812 01:17:47.778959 17412 raft_consensus.cc:2726] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:17:47.854779 17413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:47.854545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:57579)
0812 01:17:47.854689 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:47.854728 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260812 01:17:47.912725 17415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:47.912444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:34207)
0812 01:17:47.912643 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:47.912684 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":136,"threads_started":1}
I20260812 01:17:48.041708 17416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:48.041455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:56781)
0812 01:17:48.041615 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:48.041657 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":63,"threads_started":1}
I20260812 01:17:48.855469 17418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:48.855256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:60517)
0812 01:17:48.855385 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:48.855421 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260812 01:17:48.913470 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:48.913207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:33861)
0812 01:17:48.913381 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:48.913423 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":89,"threads_started":1}
I20260812 01:17:49.042492 17421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:49.042215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:47327)
0812 01:17:49.042361 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:49.042405 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
I20260812 01:17:49.856253 17424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:49.855984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:43713)
0812 01:17:49.856149 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:49.856204 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":92,"threads_started":1}
I20260812 01:17:49.914356 17426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:49.914040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:33263)
0812 01:17:49.914255 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:49.914299 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":112,"threads_started":1}
I20260812 01:17:49.957114 17429 raft_consensus.cc:482] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:17:49.957240 17429 raft_consensus.cc:504] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:49.957479 17429 leader_election.cc:288] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181), d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845)
W20260812 01:17:49.957928 16662 leader_election.cc:341] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181): Not found: Tablet not found: 21ee4345496a4409b900fa77c672f2b8
W20260812 01:17:49.958039 16654 leader_election.cc:341] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845): Not found: Tablet not found: 21ee4345496a4409b900fa77c672f2b8
I20260812 01:17:49.958074 16662 leader_election.cc:302] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa4d5b142714f828ce55731fc3d1ce7; no voters: 5576cbd093d941aeb3259887c2535ea7, d6d7070d32194e3691b9484dc2aca5e2
I20260812 01:17:49.958153 17429 raft_consensus.cc:2726] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:17:50.043227 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:50.042997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:40097)
0812 01:17:50.043147 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:50.043185 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":74,"threads_started":1}
I20260812 01:17:50.857069 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:50.856829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:53519)
0812 01:17:50.856975 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:50.857018 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":65,"threads_started":1}
I20260812 01:17:50.915221 17432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:50.914906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:40071)
0812 01:17:50.915132 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:50.915177 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":83,"threads_started":1}
I20260812 01:17:51.043978 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:51.043709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:54797)
0812 01:17:51.043886 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:51.043931 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":90,"threads_started":1}
I20260812 01:17:51.857800 17437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:51.857573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:37251)
0812 01:17:51.857714 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:51.857752 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260812 01:17:51.915982 17439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:51.915675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:41271)
0812 01:17:51.915879 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:51.915929 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":86,"threads_started":1}
I20260812 01:17:52.044809 17440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:52.044586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:42235)
0812 01:17:52.044718 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:52.044764 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260812 01:17:52.119818 17442 raft_consensus.cc:482] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:17:52.119916 17442 raft_consensus.cc:504] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:52.120136 17442 leader_election.cc:288] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181), d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845)
W20260812 01:17:52.120622 16662 leader_election.cc:341] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181): Not found: Tablet not found: 21ee4345496a4409b900fa77c672f2b8
W20260812 01:17:52.120716 16654 leader_election.cc:341] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845): Not found: Tablet not found: 21ee4345496a4409b900fa77c672f2b8
I20260812 01:17:52.120810 16654 leader_election.cc:302] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa4d5b142714f828ce55731fc3d1ce7; no voters: 5576cbd093d941aeb3259887c2535ea7, d6d7070d32194e3691b9484dc2aca5e2
I20260812 01:17:52.120918 17442 raft_consensus.cc:2726] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:17:52.858721 17444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:52.858437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:38885)
0812 01:17:52.858627 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:52.858673 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":66,"threads_started":1}
I20260812 01:17:52.916823 17447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:52.916561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:55989)
0812 01:17:52.916691 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:52.916762 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":60,"threads_started":1}
I20260812 01:17:53.045537 17449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:53.045315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:60539)
0812 01:17:53.045445 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:53.045489 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260812 01:17:53.859469 17451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:53.859233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:44079)
0812 01:17:53.859383 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:53.859420 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":64,"threads_started":1}
I20260812 01:17:53.917563 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:53.917318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:57769)
0812 01:17:53.917477 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:53.917518 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":64,"threads_started":1}
I20260812 01:17:54.046303 17458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:54.046059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:47095)
0812 01:17:54.046200 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:54.046256 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260812 01:17:54.860361 17463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:54.860128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:36223)
0812 01:17:54.860264 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:54.860311 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":70,"threads_started":1}
I20260812 01:17:54.918270 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:54.918043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:41993)
0812 01:17:54.918178 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:54.918214 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
I20260812 01:17:55.047143 17468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:55.046903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:55599)
0812 01:17:55.047057 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:55.047096 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":68,"threads_started":1}
I20260812 01:17:55.861174 17469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:55.860940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:59815)
0812 01:17:55.861071 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:55.861114 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
I20260812 01:17:55.919111 17470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:55.918868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:46483)
0812 01:17:55.919010 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:55.919048 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":66,"threads_started":1}
I20260812 01:17:56.047926 17471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:56.047672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:51963)
0812 01:17:56.047840 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:56.047880 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":83,"threads_started":1}
I20260812 01:17:56.299862 17472 raft_consensus.cc:482] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:17:56.299966 17472 raft_consensus.cc:504] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5576cbd093d941aeb3259887c2535ea7" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 43181 } } peers { permanent_uuid: "2fa4d5b142714f828ce55731fc3d1ce7" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 37417 } } peers { permanent_uuid: "d6d7070d32194e3691b9484dc2aca5e2" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42845 } }
I20260812 01:17:56.300218 17472 leader_election.cc:288] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181), d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845)
W20260812 01:17:56.300638 16654 leader_election.cc:341] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d6d7070d32194e3691b9484dc2aca5e2 (127.17.183.130:42845): Not found: Tablet not found: 21ee4345496a4409b900fa77c672f2b8
W20260812 01:17:56.300765 16662 leader_election.cc:341] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5576cbd093d941aeb3259887c2535ea7 (127.17.183.131:43181): Not found: Tablet not found: 21ee4345496a4409b900fa77c672f2b8
I20260812 01:17:56.300920 16662 leader_election.cc:302] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa4d5b142714f828ce55731fc3d1ce7; no voters: 5576cbd093d941aeb3259887c2535ea7, d6d7070d32194e3691b9484dc2aca5e2
I20260812 01:17:56.301016 17472 raft_consensus.cc:2726] T 21ee4345496a4409b900fa77c672f2b8 P 2fa4d5b142714f828ce55731fc3d1ce7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:17:56.861876 17474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:56.861649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:59137)
0812 01:17:56.861794 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:56.861828 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260812 01:17:56.919850 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:56.919629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:37595)
0812 01:17:56.919759 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:56.919803 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260812 01:17:57.048771 17483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:57.048461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:50777)
0812 01:17:57.048678 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:57.048723 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":117,"threads_started":1}
I20260812 01:17:57.862705 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:57.862440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:39341)
0812 01:17:57.862617 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:57.862656 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":83,"threads_started":1}
I20260812 01:17:57.920624 17490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:57.920353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:54059)
0812 01:17:57.920528 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:57.920576 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":100,"threads_started":1}
I20260812 01:17:58.049525 17491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:58.049305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:49169)
0812 01:17:58.049437 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:58.049474 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260812 01:17:58.863418 17492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:58.863167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:33339)
0812 01:17:58.863326 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:58.863368 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":67,"threads_started":1}
I20260812 01:17:58.921311 17493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:58.921104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:55693)
0812 01:17:58.921227 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:58.921265 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260812 01:17:59.050269 17495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:59.050035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:52381)
0812 01:17:59.050173 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:59.050214 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":65,"threads_started":1}
I20260812 01:17:59.864387 17496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:59.864087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.129:57291)
0812 01:17:59.864298 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:59.864340 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":96,"threads_started":1}
I20260812 01:17:59.922040 17500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:17:59.921802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.130:44151)
0812 01:17:59.921963 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 01:17:59.921995 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":107,"threads_started":1}
I20260812 01:18:00.045835 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 16548
I20260812 01:18:00.056609 17501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:00.052625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43815 (local address 127.17.183.131:51445)
0812 01:18:00.056471 (+ 3846us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:00.056544 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.190:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3824,"thread_start_us":3388,"threads_started":1}
I20260812 01:18:00.062758 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 16891
I20260812 01:18:00.080251 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 17148
2026-08-12T01:18:00Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58846 ms)
[----------] 30 tests from SecurityITest (244200 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:00 dist-test-slave-rwrg krb5kdc[17507](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:00 dist-test-slave-rwrg krb5kdc[17507](info): set up 2 sockets
Aug 12 01:18:00 dist-test-slave-rwrg krb5kdc[17507](info): commencing operation
krb5kdc: starting...
W20260812 01:18:01.458315 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.350s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:01 dist-test-slave-rwrg krb5kdc[17507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:18:01.583554 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33267
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:39071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:33267
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:01.667045 17533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:01.667301 17533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:01.667339 17533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:01.668465 17533 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:01.668552 17533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:01.668577 17533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:01.668597 17533 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:01.668628 17533 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:01.670166 17533 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:39071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:33267
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:01.670465 17533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:01.670701 17533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:01.675694 17547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:01.675714 17541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:01.675705 17542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:01.675841 17533 server_base.cc:1034] running on GCE node
I20260812 01:18:01.676213 17533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:01.676560 17533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:01.677757 17533 hybrid_clock.cc:648] HybridClock initialized: now 1786497481677747 us; error 31 us; skew 500 ppm
Aug 12 01:18:01 dist-test-slave-rwrg krb5kdc[17507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497481, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:01.680284 17533 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:18:01.680814 17533 webserver.cc:460] Webserver started at http://127.17.183.190:38835/ using document root <none> and password file <none>
I20260812 01:18:01.681053 17533 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:01.681119 17533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:01.681267 17533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:01.682327 17533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "564924b023f041fcb40df05e4e8e927d"
format_stamp: "Formatted at 2026-08-12 01:18:01 on dist-test-slave-rwrg"
server_key: "65558fd21c15dc6622df7ebb7727b502"
server_key_iv: "2e1ff6dc398765095fe09020a8018c92"
server_key_version: "encryptionkey@0"
I20260812 01:18:01.682699 17533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "564924b023f041fcb40df05e4e8e927d"
format_stamp: "Formatted at 2026-08-12 01:18:01 on dist-test-slave-rwrg"
server_key: "65558fd21c15dc6622df7ebb7727b502"
server_key_iv: "2e1ff6dc398765095fe09020a8018c92"
server_key_version: "encryptionkey@0"
I20260812 01:18:01.684089 17533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 01:18:01.684898 17562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:01.685075 17533 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:01.685186 17533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "564924b023f041fcb40df05e4e8e927d"
format_stamp: "Formatted at 2026-08-12 01:18:01 on dist-test-slave-rwrg"
server_key: "65558fd21c15dc6622df7ebb7727b502"
server_key_iv: "2e1ff6dc398765095fe09020a8018c92"
server_key_version: "encryptionkey@0"
I20260812 01:18:01.685261 17533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:01.700341 17533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:01.702217 17533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:01.702383 17533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:01.707234 17533 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:33267
I20260812 01:18:01.707312 17675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:33267 every 8 connection(s)
I20260812 01:18:01.707787 17533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:01.708952 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 17533
I20260812 01:18:01.709084 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:01.709065 17680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:01.709335 18142 external_mini_cluster.cc:1428] Setting key 4f7fa5f8363ff64c08f554915d0d9f28
I20260812 01:18:01.713513 17680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d: Bootstrap starting.
I20260812 01:18:01.714289 17680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:01.714610 17680 log.cc:824] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:01.715416 17680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d: No bootstrap required, opened a new log
Aug 12 01:18:01 dist-test-slave-rwrg krb5kdc[17507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:01.717854 17680 raft_consensus.cc:348] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564924b023f041fcb40df05e4e8e927d" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33267 } }
I20260812 01:18:01.718029 17680 raft_consensus.cc:374] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:01.718077 17680 raft_consensus.cc:729] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 564924b023f041fcb40df05e4e8e927d, State: Initialized, Role: FOLLOWER
I20260812 01:18:01.718206 17680 consensus_queue.cc:260] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564924b023f041fcb40df05e4e8e927d" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33267 } }
I20260812 01:18:01.718312 17680 raft_consensus.cc:388] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:01.718358 17680 raft_consensus.cc:482] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:01.718400 17680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:01.718940 17680 raft_consensus.cc:504] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564924b023f041fcb40df05e4e8e927d" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33267 } }
I20260812 01:18:01.719031 17680 leader_election.cc:302] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 564924b023f041fcb40df05e4e8e927d; no voters:
I20260812 01:18:01.719230 17680 leader_election.cc:288] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:01.719265 17688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:01.719439 17688 raft_consensus.cc:686] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [term 1 LEADER]: Becoming Leader. State: Replica: 564924b023f041fcb40df05e4e8e927d, State: Running, Role: LEADER
I20260812 01:18:01.719578 17680 sys_catalog.cc:564] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:01.719609 17688 consensus_queue.cc:237] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564924b023f041fcb40df05e4e8e927d" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33267 } }
I20260812 01:18:01.720000 17688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 564924b023f041fcb40df05e4e8e927d. Latest consensus state: current_term: 1 leader_uuid: "564924b023f041fcb40df05e4e8e927d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564924b023f041fcb40df05e4e8e927d" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33267 } } }
I20260812 01:18:01.720090 17688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:01.720376 17689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "564924b023f041fcb40df05e4e8e927d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564924b023f041fcb40df05e4e8e927d" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33267 } } }
I20260812 01:18:01.720455 17689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d [sys.catalog]: This master's current role is: LEADER
W20260812 01:18:01.721577 17726 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:18:01.721640 17726 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:18:01.721830 17686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:01.709860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36426 (local address 127.17.183.190:33267)
0812 01:18:01.710035 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:01.710045 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:01.710082 (+ 37us) server_negotiation.cc:407] Connection header received
0812 01:18:01.710749 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:01.710759 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:01.710834 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:01.710976 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:01.711815 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:01.713239 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:01.714148 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:01.714790 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:01.714927 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:01.717712 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:01.717716 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:01.717716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:01.717726 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:01.719912 (+ 2186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:01.720339 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:01.720341 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:01.720342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:01.720448 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:01.720745 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:01.720746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:01.720746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:01.720980 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:01.721154 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:01.721475 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 01:18:01.721601 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260812 01:18:01.721870 17710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:01.722421 17710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:01.723937 17710 catalog_manager.cc:1347] Generated new cluster ID: d6afff2006ef4edebd92dc3652b54d21
I20260812 01:18:01.723992 17710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:01.748919 17710 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:01.749733 17710 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:01.753952 17710 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d: Generated new TSK 0
I20260812 01:18:01.754144 17710 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:18:01.790766 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33267
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:39071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:01.877673 17745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:01.877871 17745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:01.877894 17745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:01.879092 17745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:01.879140 17745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:01.879166 17745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:18:01.880791 17745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:39071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:01.881084 17745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:01.881363 17745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:01.886396 17756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:01.886443 17754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:01.886411 17762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:01.886624 17745 server_base.cc:1034] running on GCE node
I20260812 01:18:01.886899 17745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:01.887172 17745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:01.888334 17745 hybrid_clock.cc:648] HybridClock initialized: now 1786497481888328 us; error 40 us; skew 500 ppm
Aug 12 01:18:01 dist-test-slave-rwrg krb5kdc[17507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497481, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:01.891095 17745 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:18:01.891546 17745 webserver.cc:460] Webserver started at http://127.17.183.129:43773/ using document root <none> and password file <none>
I20260812 01:18:01.891743 17745 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:01.891784 17745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:01.891871 17745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:01.892900 17745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "6b9594424b844ef898d183d1d45491fb"
format_stamp: "Formatted at 2026-08-12 01:18:01 on dist-test-slave-rwrg"
server_key: "033be9bc16818d46d82e80cd24caa46f"
server_key_iv: "826aedf68b0b9085caafd2f4c26546b7"
server_key_version: "encryptionkey@0"
I20260812 01:18:01.893210 17745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "6b9594424b844ef898d183d1d45491fb"
format_stamp: "Formatted at 2026-08-12 01:18:01 on dist-test-slave-rwrg"
server_key: "033be9bc16818d46d82e80cd24caa46f"
server_key_iv: "826aedf68b0b9085caafd2f4c26546b7"
server_key_version: "encryptionkey@0"
I20260812 01:18:01.894474 17745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:01.895188 17776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:01.895398 17745 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:01.895488 17745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "6b9594424b844ef898d183d1d45491fb"
format_stamp: "Formatted at 2026-08-12 01:18:01 on dist-test-slave-rwrg"
server_key: "033be9bc16818d46d82e80cd24caa46f"
server_key_iv: "826aedf68b0b9085caafd2f4c26546b7"
server_key_version: "encryptionkey@0"
I20260812 01:18:01.895545 17745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:01.905521 17745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:01.907375 17745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:01.907493 17745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:01.907670 17745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:01.908003 17745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:01.908039 17745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:01.908061 17745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:01.908114 17745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:01.914243 17745 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:42613
I20260812 01:18:01.914341 17988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:42613 every 8 connection(s)
I20260812 01:18:01.914655 17745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:18:01.917065 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 17745
I20260812 01:18:01.917184 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:18:01.917400 18142 external_mini_cluster.cc:1428] Setting key 2911c3963caba76cf204aae70ee08e45
Aug 12 01:18:01 dist-test-slave-rwrg krb5kdc[17507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497481, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:01.925305 17686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:01.915432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:39689 (local address 127.17.183.190:33267)
0812 01:18:01.915504 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:01.915506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:01.915733 (+ 227us) server_negotiation.cc:407] Connection header received
0812 01:18:01.916202 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:01.916203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:01.916213 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:01.916266 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:01.917350 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:01.918034 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:01.919097 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:01.919319 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:01.919396 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:01.922321 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:01.922322 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:01.922322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:01.922329 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:01.923732 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:01.924256 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:01.924257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:01.924257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:01.924307 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:01.924653 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:01.924653 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:01.924653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:01.924758 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:01.924811 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:01.925173 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 01:18:01.925240 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 01:18:01.925585 17999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:01.915405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33267 (local address 127.17.183.129:39689)
0812 01:18:01.915608 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:01.915645 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:01.916115 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:01.916348 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:01.916351 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:01.916998 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:01.917225 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:01.917233 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:01.918136 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:01.918138 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:01.919015 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:01.919018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:01.919406 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:01.919407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:01.919590 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:01.920237 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:01.920247 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:01.922224 (+ 1977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:01.923822 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:01.923831 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:01.923833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:01.924174 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:01.924377 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:01.924378 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:01.924379 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:01.924577 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:01.924832 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:01.924840 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:01.925020 (+ 180us) client_negotiation.cc:769] Sending connection context
0812 01:18:01.925141 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 01:18:01.925330 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":110,"threads_started":1}
I20260812 01:18:01.926170 17995 heartbeater.cc:347] Connected to a master server at 127.17.183.190:33267
I20260812 01:18:01.926270 17995 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:01.926455 17995 heartbeater.cc:511] Master 127.17.183.190:33267 requested a full tablet report, sending...
I20260812 01:18:01.926962 17598 ts_manager.cc:194] Registered new tserver with Master: 6b9594424b844ef898d183d1d45491fb (127.17.183.129:42613)
I20260812 01:18:01.927568 17598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:39689
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:18:01.947276 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33267
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:39071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:02.032373 18004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:02.032635 18004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:02.032687 18004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:02.033864 18004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:02.033938 18004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:02.033985 18004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:18:02.035542 18004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:39071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:02.035843 18004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:02.036090 18004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:02.041445 18012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:02.041473 18024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:02.041462 18013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:02.041721 18004 server_base.cc:1034] running on GCE node
I20260812 01:18:02.041967 18004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:02.042253 18004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:02.043417 18004 hybrid_clock.cc:648] HybridClock initialized: now 1786497482043405 us; error 27 us; skew 500 ppm
Aug 12 01:18:02 dist-test-slave-rwrg krb5kdc[17507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497482, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:02.045992 18004 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:18:02.046479 18004 webserver.cc:460] Webserver started at http://127.17.183.130:44759/ using document root <none> and password file <none>
I20260812 01:18:02.046744 18004 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:02.046813 18004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:02.046963 18004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:02.048019 18004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "2477eb472bbd4d51b556944d668f64e4"
format_stamp: "Formatted at 2026-08-12 01:18:02 on dist-test-slave-rwrg"
server_key: "0932a0b376af8f11067520dd1c214fd3"
server_key_iv: "f1c35b49d0585ebf11115ee0389145ef"
server_key_version: "encryptionkey@0"
I20260812 01:18:02.048383 18004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "2477eb472bbd4d51b556944d668f64e4"
format_stamp: "Formatted at 2026-08-12 01:18:02 on dist-test-slave-rwrg"
server_key: "0932a0b376af8f11067520dd1c214fd3"
server_key_iv: "f1c35b49d0585ebf11115ee0389145ef"
server_key_version: "encryptionkey@0"
I20260812 01:18:02.049846 18004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:18:02.050652 18045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:02.050977 18004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 01:18:02.051090 18004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "2477eb472bbd4d51b556944d668f64e4"
format_stamp: "Formatted at 2026-08-12 01:18:02 on dist-test-slave-rwrg"
server_key: "0932a0b376af8f11067520dd1c214fd3"
server_key_iv: "f1c35b49d0585ebf11115ee0389145ef"
server_key_version: "encryptionkey@0"
I20260812 01:18:02.051168 18004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:02.075322 18004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:02.077503 18004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:02.077698 18004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:02.077963 18004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:02.078310 18004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:02.078369 18004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:02.078416 18004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:02.078441 18004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:02.085142 18004 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:45477
I20260812 01:18:02.085194 18273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:45477 every 8 connection(s)
I20260812 01:18:02.085557 18004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
Aug 12 01:18:02 dist-test-slave-rwrg krb5kdc[17507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497482, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:02.092775 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 18004
I20260812 01:18:02.092919 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:18:02.093123 18142 external_mini_cluster.cc:1428] Setting key 23188a995c85a53b2c5f0af7360b65f9
I20260812 01:18:02.095745 17686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.086309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:46911 (local address 127.17.183.190:33267)
0812 01:18:02.086357 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:02.086359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:02.086579 (+ 220us) server_negotiation.cc:407] Connection header received
0812 01:18:02.087174 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:02.087176 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:02.087190 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:02.087244 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:02.088274 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.088860 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.089895 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.090102 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.090183 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.092364 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:02.092366 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:02.092366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:02.092374 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:02.094235 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:02.094708 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:02.094709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:02.094710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:02.094795 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:02.095033 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:02.095033 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:02.095034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:02.095183 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:02.095254 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:02.095490 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 01:18:02.095592 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 01:18:02.095746 18285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.086274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33267 (local address 127.17.183.130:46911)
0812 01:18:02.086453 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:02.086491 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:02.087058 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:02.087318 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:02.087322 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:02.087951 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:02.088171 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.088176 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.088958 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.088959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.089797 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.089799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.090191 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.090192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.090327 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.090879 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:02.090887 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:02.092266 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:02.094319 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:02.094325 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:02.094327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:02.094623 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:02.094866 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:02.094867 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:02.094867 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:02.094967 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:02.095249 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:02.095253 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:02.095364 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 01:18:02.095444 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 01:18:02.095559 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":84,"threads_started":1}
I20260812 01:18:02.096669 18279 heartbeater.cc:347] Connected to a master server at 127.17.183.190:33267
I20260812 01:18:02.096781 18279 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:02.096994 18279 heartbeater.cc:511] Master 127.17.183.190:33267 requested a full tablet report, sending...
I20260812 01:18:02.097422 17598 ts_manager.cc:194] Registered new tserver with Master: 2477eb472bbd4d51b556944d668f64e4 (127.17.183.130:45477)
I20260812 01:18:02.097947 17598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:46911
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:18:02.121073 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33267
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:39071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:02.206264 18293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:02.206481 18293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:02.206506 18293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:02.207553 18293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:02.207589 18293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:02.207613 18293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:18:02.209160 18293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:39071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:02.209421 18293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:02.209661 18293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:02.214908 18302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:02.214953 18300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:02.214980 18293 server_base.cc:1034] running on GCE node
W20260812 01:18:02.214962 18307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:02.215436 18293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:02.215711 18293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:02.216893 18293 hybrid_clock.cc:648] HybridClock initialized: now 1786497482216878 us; error 31 us; skew 500 ppm
Aug 12 01:18:02 dist-test-slave-rwrg krb5kdc[17507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497482, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:02.219353 18293 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:18:02.219959 18293 webserver.cc:460] Webserver started at http://127.17.183.131:33203/ using document root <none> and password file <none>
I20260812 01:18:02.220222 18293 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:02.220289 18293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:02.220446 18293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:02.221707 18293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "944b785fd2ee41d98ac5a9d10792ee71"
format_stamp: "Formatted at 2026-08-12 01:18:02 on dist-test-slave-rwrg"
server_key: "11ad9f54cd7db831bf7c9567d23aee47"
server_key_iv: "7747593eb97d9c8d3e2bee6753f65270"
server_key_version: "encryptionkey@0"
I20260812 01:18:02.222092 18293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "944b785fd2ee41d98ac5a9d10792ee71"
format_stamp: "Formatted at 2026-08-12 01:18:02 on dist-test-slave-rwrg"
server_key: "11ad9f54cd7db831bf7c9567d23aee47"
server_key_iv: "7747593eb97d9c8d3e2bee6753f65270"
server_key_version: "encryptionkey@0"
I20260812 01:18:02.223481 18293 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:02.224315 18325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:02.224602 18293 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:18:02.224720 18293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "944b785fd2ee41d98ac5a9d10792ee71"
format_stamp: "Formatted at 2026-08-12 01:18:02 on dist-test-slave-rwrg"
server_key: "11ad9f54cd7db831bf7c9567d23aee47"
server_key_iv: "7747593eb97d9c8d3e2bee6753f65270"
server_key_version: "encryptionkey@0"
I20260812 01:18:02.224815 18293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:02.261077 18293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:02.263240 18293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:02.263433 18293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:02.263697 18293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:02.264071 18293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:02.264133 18293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:02.264186 18293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:02.264219 18293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:02.271958 18293 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:46783
I20260812 01:18:02.272048 18546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:46783 every 8 connection(s)
I20260812 01:18:02.272580 18293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:18:02.276937 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 18293
I20260812 01:18:02.277056 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:18:02.277273 18142 external_mini_cluster.cc:1428] Setting key 3b87b57ee757921b9556bf4df810c46d
Aug 12 01:18:02 dist-test-slave-rwrg krb5kdc[17507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497482, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:02.282460 17686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.273379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:59115 (local address 127.17.183.190:33267)
0812 01:18:02.273458 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:02.273460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:02.273677 (+ 217us) server_negotiation.cc:407] Connection header received
0812 01:18:02.274188 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:02.274189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:02.274200 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:02.274261 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:02.275236 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.275741 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.276860 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.277098 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.277164 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.279523 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:02.279525 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:02.279525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:02.279532 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:02.281063 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:02.281494 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:02.281496 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:02.281496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:02.281557 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:02.281818 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:02.281819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:02.281819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:02.281935 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:02.282006 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:02.282289 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 01:18:02.282366 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 01:18:02.282683 18554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.273362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33267 (local address 127.17.183.131:59115)
0812 01:18:02.273530 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:02.273575 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:02.274099 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:02.274322 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:02.274325 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:02.274929 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:02.275123 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.275128 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.275845 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.275846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.276766 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.276769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.277204 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.277206 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.277330 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.277937 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:02.277945 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:02.279422 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:02.281169 (+ 1747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:02.281177 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:02.281179 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:02.281411 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:02.281632 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:02.281633 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:02.281633 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:02.281750 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:02.282010 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:02.282018 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:02.282153 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 01:18:02.282268 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 01:18:02.282428 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260812 01:18:02.283208 18547 heartbeater.cc:347] Connected to a master server at 127.17.183.190:33267
I20260812 01:18:02.283313 18547 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:02.283501 18547 heartbeater.cc:511] Master 127.17.183.190:33267 requested a full tablet report, sending...
I20260812 01:18:02.283994 17598 ts_manager.cc:194] Registered new tserver with Master: 944b785fd2ee41d98ac5a9d10792ee71 (127.17.183.131:46783)
I20260812 01:18:02.284382 17598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:59115
I20260812 01:18:02.289193 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:18:02.296262 17686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.290549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36442 (local address 127.17.183.190:33267)
0812 01:18:02.290614 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:02.290616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:02.290702 (+ 86us) server_negotiation.cc:407] Connection header received
0812 01:18:02.290751 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:02.290752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:02.290760 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:02.290805 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:02.291300 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.291779 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.292486 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.292721 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.292774 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.293874 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:02.293875 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:02.293875 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:02.293881 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:02.295266 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:02.295581 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:02.295582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:02.295582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:02.295632 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:02.295791 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:02.295792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:02.295792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:02.295929 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:02.296017 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:02.296121 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 01:18:02.296177 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 01:18:02.298194 17598 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36442:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:18:02.299875 17598 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:18:02.307003 18576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.302417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:46783 (local address 127.0.0.1:33288)
0812 01:18:02.302836 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:02.302848 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:02.302895 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:02.303301 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:02.303302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:02.303304 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:02.303362 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.303364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.304714 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.304715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.305934 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.305936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.306642 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.306644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.306728 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.306743 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 01:18:02.306824 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 01:18:02.306904 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":47,"thread_start_us":48,"threads_started":1}
I20260812 01:18:02.307021 18573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.302517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33288 (local address 127.17.183.131:46783)
0812 01:18:02.303146 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:02.303150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:02.303157 (+ 7us) server_negotiation.cc:407] Connection header received
0812 01:18:02.303211 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:02.303213 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:02.303228 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:02.303303 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:02.303445 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.304600 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.306028 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.306527 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.306641 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.306701 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:02.306848 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 01:18:02.306906 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":117,"threads_started":1}
I20260812 01:18:02.307039 18577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.302951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49920 (local address 127.17.183.130:45477)
0812 01:18:02.303133 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:02.303137 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:02.303148 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:18:02.303188 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:02.303190 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:02.303206 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:02.303377 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:02.303517 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.304634 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.305759 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.306535 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.306612 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.306669 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:02.306882 (+ 213us) server_negotiation.cc:299] Negotiation successful
0812 01:18:02.306936 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260812 01:18:02.307039 18571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.302520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38504 (local address 127.17.183.129:42613)
0812 01:18:02.302723 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:02.302728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:02.302740 (+ 12us) server_negotiation.cc:407] Connection header received
0812 01:18:02.302804 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:02.302806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:02.302823 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:02.302912 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:02.303506 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.304230 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.305838 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.306534 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.306612 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.306669 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:02.306882 (+ 213us) server_negotiation.cc:299] Negotiation successful
0812 01:18:02.306939 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":101,"threads_started":1}
I20260812 01:18:02.307652 18568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.302417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:42613 (local address 127.0.0.1:38504)
0812 01:18:02.302589 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:02.302630 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:02.302692 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:02.303149 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:02.303153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:02.303157 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:02.303256 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.303258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.304336 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.304337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.305696 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.305698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.306708 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.306709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.306777 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.306781 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:02.306833 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 01:18:02.307561 (+ 728us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":668,"thread_start_us":144,"threads_started":1}
I20260812 01:18:02.307760 18569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.302682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:45477 (local address 127.0.0.1:49920)
0812 01:18:02.303014 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:02.303022 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:02.303054 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:02.303373 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:02.303374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:02.303376 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:02.303429 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.303430 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.304745 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.304746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.305672 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.305674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.306715 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.306715 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.306783 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.306786 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:18:02.306833 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 01:18:02.307611 (+ 778us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":718,"thread_start_us":95,"threads_started":1}
I20260812 01:18:02.308513 18414 tablet_service.cc:1467] Processing CreateTablet for tablet 0959bc4a58944e8785a91668d2cb8d82 (DEFAULT_TABLE table=test-table [id=9787ecb858154ac39e8d967425c4967d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:02.308722 18134 tablet_service.cc:1467] Processing CreateTablet for tablet 0959bc4a58944e8785a91668d2cb8d82 (DEFAULT_TABLE table=test-table [id=9787ecb858154ac39e8d967425c4967d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:02.308764 17870 tablet_service.cc:1467] Processing CreateTablet for tablet 0959bc4a58944e8785a91668d2cb8d82 (DEFAULT_TABLE table=test-table [id=9787ecb858154ac39e8d967425c4967d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:02.308954 18414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0959bc4a58944e8785a91668d2cb8d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:02.309070 17870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0959bc4a58944e8785a91668d2cb8d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:02.309155 18134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0959bc4a58944e8785a91668d2cb8d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:02.312069 18578 tablet_bootstrap.cc:492] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: Bootstrap starting.
I20260812 01:18:02.312393 18580 tablet_bootstrap.cc:492] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: Bootstrap starting.
I20260812 01:18:02.312908 18582 tablet_bootstrap.cc:492] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb: Bootstrap starting.
I20260812 01:18:02.313242 18578 tablet_bootstrap.cc:654] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:02.313331 18580 tablet_bootstrap.cc:654] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:02.313602 18582 tablet_bootstrap.cc:654] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:02.313922 18580 log.cc:824] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:02.313939 18578 log.cc:824] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:02.314217 18582 log.cc:824] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:02.314765 18578 tablet_bootstrap.cc:492] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: No bootstrap required, opened a new log
I20260812 01:18:02.314855 18578 ts_tablet_manager.cc:1397] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 01:18:02.314985 18582 tablet_bootstrap.cc:492] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb: No bootstrap required, opened a new log
I20260812 01:18:02.315039 18582 ts_tablet_manager.cc:1397] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:18:02.316334 18578 raft_consensus.cc:348] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b785fd2ee41d98ac5a9d10792ee71" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 46783 } } peers { permanent_uuid: "6b9594424b844ef898d183d1d45491fb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42613 } } peers { permanent_uuid: "2477eb472bbd4d51b556944d668f64e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 45477 } }
I20260812 01:18:02.316499 18578 raft_consensus.cc:374] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:02.316572 18578 raft_consensus.cc:729] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2477eb472bbd4d51b556944d668f64e4, State: Initialized, Role: FOLLOWER
I20260812 01:18:02.316692 18578 consensus_queue.cc:260] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b785fd2ee41d98ac5a9d10792ee71" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 46783 } } peers { permanent_uuid: "6b9594424b844ef898d183d1d45491fb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42613 } } peers { permanent_uuid: "2477eb472bbd4d51b556944d668f64e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 45477 } }
I20260812 01:18:02.316777 18582 raft_consensus.cc:348] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b785fd2ee41d98ac5a9d10792ee71" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 46783 } } peers { permanent_uuid: "6b9594424b844ef898d183d1d45491fb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42613 } } peers { permanent_uuid: "2477eb472bbd4d51b556944d668f64e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 45477 } }
I20260812 01:18:02.316959 18580 tablet_bootstrap.cc:492] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: No bootstrap required, opened a new log
I20260812 01:18:02.316955 18582 raft_consensus.cc:374] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:02.316998 18582 raft_consensus.cc:729] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b9594424b844ef898d183d1d45491fb, State: Initialized, Role: FOLLOWER
I20260812 01:18:02.317010 18578 ts_tablet_manager.cc:1428] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 01:18:02.317025 18580 ts_tablet_manager.cc:1397] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 01:18:02.317154 18279 heartbeater.cc:503] Master 127.17.183.190:33267 was elected leader, sending a full tablet report...
I20260812 01:18:02.317157 18582 consensus_queue.cc:260] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b785fd2ee41d98ac5a9d10792ee71" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 46783 } } peers { permanent_uuid: "6b9594424b844ef898d183d1d45491fb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42613 } } peers { permanent_uuid: "2477eb472bbd4d51b556944d668f64e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 45477 } }
I20260812 01:18:02.317438 18582 ts_tablet_manager.cc:1428] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 01:18:02.317445 17995 heartbeater.cc:503] Master 127.17.183.190:33267 was elected leader, sending a full tablet report...
I20260812 01:18:02.318789 18580 raft_consensus.cc:348] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b785fd2ee41d98ac5a9d10792ee71" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 46783 } } peers { permanent_uuid: "6b9594424b844ef898d183d1d45491fb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42613 } } peers { permanent_uuid: "2477eb472bbd4d51b556944d668f64e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 45477 } }
I20260812 01:18:02.318917 18580 raft_consensus.cc:374] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:02.318939 18580 raft_consensus.cc:729] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 944b785fd2ee41d98ac5a9d10792ee71, State: Initialized, Role: FOLLOWER
I20260812 01:18:02.319064 18580 consensus_queue.cc:260] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b785fd2ee41d98ac5a9d10792ee71" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 46783 } } peers { permanent_uuid: "6b9594424b844ef898d183d1d45491fb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42613 } } peers { permanent_uuid: "2477eb472bbd4d51b556944d668f64e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 45477 } }
I20260812 01:18:02.319356 18580 ts_tablet_manager.cc:1428] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 01:18:02.319404 18547 heartbeater.cc:503] Master 127.17.183.190:33267 was elected leader, sending a full tablet report...
W20260812 01:18:02.336163 18282 tablet.cc:2369] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:18:02.415405 17998 tablet.cc:2369] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:18:02.523247 18549 tablet.cc:2369] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:18:02.629384 18598 raft_consensus.cc:482] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:18:02.629522 18598 raft_consensus.cc:504] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b785fd2ee41d98ac5a9d10792ee71" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 46783 } } peers { permanent_uuid: "6b9594424b844ef898d183d1d45491fb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42613 } } peers { permanent_uuid: "2477eb472bbd4d51b556944d668f64e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 45477 } }
I20260812 01:18:02.629990 18598 leader_election.cc:288] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 944b785fd2ee41d98ac5a9d10792ee71 (127.17.183.131:46783), 2477eb472bbd4d51b556944d668f64e4 (127.17.183.130:45477)
I20260812 01:18:02.633157 18577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.630303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:45195 (local address 127.17.183.130:45477)
0812 01:18:02.630358 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:02.630361 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:02.630438 (+ 77us) server_negotiation.cc:407] Connection header received
0812 01:18:02.630534 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:02.630535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:02.630542 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:02.630612 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:02.630822 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.631302 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.632352 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.632789 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.632847 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.632855 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:02.633033 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 01:18:02.633084 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 01:18:02.633184 18573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.630256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:51719 (local address 127.17.183.131:46783)
0812 01:18:02.630306 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:02.630308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:02.630396 (+ 88us) server_negotiation.cc:407] Connection header received
0812 01:18:02.630514 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:02.630515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:02.630528 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:02.630577 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:02.630777 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.631283 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.632344 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.632807 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.632901 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.632910 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:02.633080 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 01:18:02.633122 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 01:18:02.633175 18600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.630208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:45477 (local address 127.17.183.129:45195)
0812 01:18:02.630345 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:02.630356 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:02.630425 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:02.630631 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:02.630632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:02.630635 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:02.630717 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.630719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.631413 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.631415 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.632250 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.632252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.632878 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.632879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.632955 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.632961 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 01:18:02.633010 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 01:18:02.633069 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":2,"thread_start_us":73,"threads_started":1}
I20260812 01:18:02.633179 18602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.630169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:46783 (local address 127.17.183.129:51719)
0812 01:18:02.630329 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:02.630341 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:02.630421 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:02.630608 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:02.630609 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:02.630612 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:02.630696 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.630702 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.631366 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.631367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.632247 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:02.632250 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.632925 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.632926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:02.632980 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.632984 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:02.633058 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 01:18:02.633094 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":44,"thread_start_us":71,"threads_started":1}
I20260812 01:18:02.633576 18183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0959bc4a58944e8785a91668d2cb8d82" candidate_uuid: "6b9594424b844ef898d183d1d45491fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2477eb472bbd4d51b556944d668f64e4" is_pre_election: true
I20260812 01:18:02.633792 18183 raft_consensus.cc:2454] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9594424b844ef898d183d1d45491fb in term 0.
I20260812 01:18:02.633816 18459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0959bc4a58944e8785a91668d2cb8d82" candidate_uuid: "6b9594424b844ef898d183d1d45491fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "944b785fd2ee41d98ac5a9d10792ee71" is_pre_election: true
I20260812 01:18:02.633962 18459 raft_consensus.cc:2454] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9594424b844ef898d183d1d45491fb in term 0.
I20260812 01:18:02.634048 17779 leader_election.cc:302] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2477eb472bbd4d51b556944d668f64e4, 6b9594424b844ef898d183d1d45491fb; no voters:
I20260812 01:18:02.634193 18598 raft_consensus.cc:2781] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:18:02.634264 18598 raft_consensus.cc:482] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:18:02.634282 18598 raft_consensus.cc:3037] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:02.635032 18598 raft_consensus.cc:504] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b785fd2ee41d98ac5a9d10792ee71" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 46783 } } peers { permanent_uuid: "6b9594424b844ef898d183d1d45491fb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42613 } } peers { permanent_uuid: "2477eb472bbd4d51b556944d668f64e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 45477 } }
I20260812 01:18:02.635185 18598 leader_election.cc:288] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [CANDIDATE]: Term 1 election: Requested vote from peers 944b785fd2ee41d98ac5a9d10792ee71 (127.17.183.131:46783), 2477eb472bbd4d51b556944d668f64e4 (127.17.183.130:45477)
I20260812 01:18:02.635346 18459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0959bc4a58944e8785a91668d2cb8d82" candidate_uuid: "6b9594424b844ef898d183d1d45491fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "944b785fd2ee41d98ac5a9d10792ee71"
I20260812 01:18:02.635370 18183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0959bc4a58944e8785a91668d2cb8d82" candidate_uuid: "6b9594424b844ef898d183d1d45491fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2477eb472bbd4d51b556944d668f64e4"
I20260812 01:18:02.635425 18459 raft_consensus.cc:3037] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:02.635466 18183 raft_consensus.cc:3037] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:02.636161 18459 raft_consensus.cc:2454] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9594424b844ef898d183d1d45491fb in term 1.
I20260812 01:18:02.636289 18183 raft_consensus.cc:2454] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9594424b844ef898d183d1d45491fb in term 1.
I20260812 01:18:02.636350 17788 leader_election.cc:302] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9594424b844ef898d183d1d45491fb, 944b785fd2ee41d98ac5a9d10792ee71; no voters:
I20260812 01:18:02.636452 18598 raft_consensus.cc:2781] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:02.636656 18598 raft_consensus.cc:686] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [term 1 LEADER]: Becoming Leader. State: Replica: 6b9594424b844ef898d183d1d45491fb, State: Running, Role: LEADER
I20260812 01:18:02.636758 18598 consensus_queue.cc:237] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b785fd2ee41d98ac5a9d10792ee71" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 46783 } } peers { permanent_uuid: "6b9594424b844ef898d183d1d45491fb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42613 } } peers { permanent_uuid: "2477eb472bbd4d51b556944d668f64e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 45477 } }
I20260812 01:18:02.637637 17595 catalog_manager.cc:5495] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b9594424b844ef898d183d1d45491fb (127.17.183.129). New cstate: current_term: 1 leader_uuid: "6b9594424b844ef898d183d1d45491fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b785fd2ee41d98ac5a9d10792ee71" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 46783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9594424b844ef898d183d1d45491fb" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2477eb472bbd4d51b556944d668f64e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260812 01:18:02.661024 18571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.658855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38514 (local address 127.17.183.129:42613)
0812 01:18:02.658894 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:02.658896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:02.658911 (+ 15us) server_negotiation.cc:407] Connection header received
0812 01:18:02.658944 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:02.658945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:02.658960 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:02.659026 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:02.659159 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.659604 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.660302 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.660477 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.660553 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.660711 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:02.660813 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:02.660874 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:02.660913 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 01:18:02.660929 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 01:18:02.662829 18183 raft_consensus.cc:1261] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4 [term 1 FOLLOWER]: Refusing update from remote peer 6b9594424b844ef898d183d1d45491fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:02.662869 18459 raft_consensus.cc:1261] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71 [term 1 FOLLOWER]: Refusing update from remote peer 6b9594424b844ef898d183d1d45491fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:02.663192 18598 consensus_queue.cc:1035] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2477eb472bbd4d51b556944d668f64e4" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:02.663349 18603 consensus_queue.cc:1035] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "944b785fd2ee41d98ac5a9d10792ee71" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 46783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:02.666134 18609 mvcc.cc:205] Tried to move back new op lower bound from 7317493688984219648 to 7317493688880640000. Current Snapshot: MvccSnapshot[applied={T|T < 7317493688984219648}]
I20260812 01:18:02.666775 18611 mvcc.cc:205] Tried to move back new op lower bound from 7317493688984219648 to 7317493688880640000. Current Snapshot: MvccSnapshot[applied={T|T < 7317493688984219648}]
I20260812 01:18:02.668143 17598 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:02.668241 17598 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:02.669039 17598 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 564924b023f041fcb40df05e4e8e927d: Sending DeleteTablet for 3 replicas of tablet 0959bc4a58944e8785a91668d2cb8d82
I20260812 01:18:02.669389 18414 tablet_service.cc:1514] Processing DeleteTablet for tablet 0959bc4a58944e8785a91668d2cb8d82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:02 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:33288
I20260812 01:18:02.669438 18134 tablet_service.cc:1514] Processing DeleteTablet for tablet 0959bc4a58944e8785a91668d2cb8d82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:02 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:49920
I20260812 01:18:02.669705 18630 tablet_replica.cc:330] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: stopping tablet replica
I20260812 01:18:02.669692 17870 tablet_service.cc:1514] Processing DeleteTablet for tablet 0959bc4a58944e8785a91668d2cb8d82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:02 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:38504
I20260812 01:18:02.669883 18630 raft_consensus.cc:2229] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:18:02.669902 18633 tablet_replica.cc:330] T 0959bc4a58944e8785a91668d2cb8d82 P 6b9594424b844ef898d183d1d45491fb: stopping tablet replica
I20260812 01:18:02.669919 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 17745
I20260812 01:18:02.678334 18632 tablet_replica.cc:330] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: stopping tablet replica
I20260812 01:18:02.678484 18632 raft_consensus.cc:2229] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:18:02.678623 18632 raft_consensus.cc:2258] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:02.679255 18632 ts_tablet_manager.cc:1905] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:02.679296 18630 raft_consensus.cc:2258] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:02.679840 18630 ts_tablet_manager.cc:1905] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:02.680877 18632 ts_tablet_manager.cc:1918] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:02.680969 18632 log.cc:1196] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/0959bc4a58944e8785a91668d2cb8d82
I20260812 01:18:02.681247 18632 ts_tablet_manager.cc:1939] T 0959bc4a58944e8785a91668d2cb8d82 P 2477eb472bbd4d51b556944d668f64e4: Deleting consensus metadata
I20260812 01:18:02.681692 17563 catalog_manager.cc:4841] TS 2477eb472bbd4d51b556944d668f64e4 (127.17.183.130:45477): tablet 0959bc4a58944e8785a91668d2cb8d82 (table test-table [id=9787ecb858154ac39e8d967425c4967d]) successfully deleted
I20260812 01:18:02.681934 18630 ts_tablet_manager.cc:1918] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:02.682014 18630 log.cc:1196] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/0959bc4a58944e8785a91668d2cb8d82
I20260812 01:18:02.682273 18630 ts_tablet_manager.cc:1939] T 0959bc4a58944e8785a91668d2cb8d82 P 944b785fd2ee41d98ac5a9d10792ee71: Deleting consensus metadata
I20260812 01:18:02.682701 17566 catalog_manager.cc:4841] TS 944b785fd2ee41d98ac5a9d10792ee71 (127.17.183.131:46783): tablet 0959bc4a58944e8785a91668d2cb8d82 (table test-table [id=9787ecb858154ac39e8d967425c4967d]) successfully deleted
W20260812 01:18:02.684052 17563 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:42613 (error 108)
I20260812 01:18:02.684614 18568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.684434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:42613 (local address 127.0.0.1:38518)
0812 01:18:02.684537 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:02.684587 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:42613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 01:18:02.684635 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 18004
W20260812 01:18:02.691483 17563 catalog_manager.cc:4584] TS 6b9594424b844ef898d183d1d45491fb (127.17.183.129:42613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0959bc4a58944e8785a91668d2cb8d82: Network error: Client connection negotiation failed: client connection to 127.17.183.129:42613: connect: Connection refused (error 111)
I20260812 01:18:02.724738 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 18293
I20260812 01:18:02.734405 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 17533
2026-08-12T01:18:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2651 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T01:18:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:02Z Disabled control of system clock
I20260812 01:18:02.768710 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:38843
--webserver_interface=127.17.183.190
--webserver_port=0
--builtin_ntp_servers=127.17.183.148:41391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:38843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:18:02.853164 18644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:02.853399 18644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:02.853422 18644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:02.854720 18644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:02.854766 18644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:02.854781 18644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:02.854836 18644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:02.854856 18644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:02.856349 18644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:38843
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:38843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:02.856655 18644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:02.856976 18644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 01:18:02.861989 18644 server_base.cc:1034] running on GCE node
W20260812 01:18:02.861972 18654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:02.861961 18658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:02.861980 18656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:02.862496 18644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:02.862818 18644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:02.863992 18644 hybrid_clock.cc:648] HybridClock initialized: now 1786497482863978 us; error 46 us; skew 500 ppm
I20260812 01:18:02.870775 18644 webserver.cc:460] Webserver started at http://127.17.183.190:32887/ using document root <none> and password file <none>
I20260812 01:18:02.871026 18644 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:02.871112 18644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:02.871270 18644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:02.872360 18644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "4bce82228d4348b4ac346e109cf45f25"
format_stamp: "Formatted at 2026-08-12 01:18:02 on dist-test-slave-rwrg"
server_key: "6e169070f5d54ce3a2d036919abda975"
server_key_iv: "5c5cf408d38856af519dc6baef2c5f7d"
server_key_version: "encryptionkey@0"
I20260812 01:18:02.872758 18644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "4bce82228d4348b4ac346e109cf45f25"
format_stamp: "Formatted at 2026-08-12 01:18:02 on dist-test-slave-rwrg"
server_key: "6e169070f5d54ce3a2d036919abda975"
server_key_iv: "5c5cf408d38856af519dc6baef2c5f7d"
server_key_version: "encryptionkey@0"
I20260812 01:18:02.874109 18644 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:02.874859 18669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:02.875029 18644 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:02.875149 18644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "4bce82228d4348b4ac346e109cf45f25"
format_stamp: "Formatted at 2026-08-12 01:18:02 on dist-test-slave-rwrg"
server_key: "6e169070f5d54ce3a2d036919abda975"
server_key_iv: "5c5cf408d38856af519dc6baef2c5f7d"
server_key_version: "encryptionkey@0"
I20260812 01:18:02.875224 18644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:02.894348 18644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:02.894666 18644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:02.894817 18644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:02.898775 18644 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:38843
I20260812 01:18:02.898813 18760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:38843 every 8 connection(s)
I20260812 01:18:02.899236 18644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:02.900231 18763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:02.902559 18763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25: Bootstrap starting.
I20260812 01:18:02.903198 18763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:02.903555 18763 log.cc:824] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:02.903798 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 18644
I20260812 01:18:02.903927 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:02.904145 18142 external_mini_cluster.cc:1428] Setting key 443cba5adfff66c988fa1cbbb097835f
I20260812 01:18:02.904419 18763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25: No bootstrap required, opened a new log
I20260812 01:18:02.907495 18763 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bce82228d4348b4ac346e109cf45f25" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38843 } }
I20260812 01:18:02.907663 18763 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:02.907692 18763 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bce82228d4348b4ac346e109cf45f25, State: Initialized, Role: FOLLOWER
I20260812 01:18:02.907817 18763 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bce82228d4348b4ac346e109cf45f25" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38843 } }
I20260812 01:18:02.907920 18763 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:02.907953 18763 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:02.908001 18763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:02.908618 18763 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bce82228d4348b4ac346e109cf45f25" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38843 } }
I20260812 01:18:02.908736 18763 leader_election.cc:302] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bce82228d4348b4ac346e109cf45f25; no voters:
I20260812 01:18:02.908905 18763 leader_election.cc:288] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:02.908998 18776 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:02.909191 18776 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [term 1 LEADER]: Becoming Leader. State: Replica: 4bce82228d4348b4ac346e109cf45f25, State: Running, Role: LEADER
I20260812 01:18:02.909194 18763 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:02.909302 18776 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bce82228d4348b4ac346e109cf45f25" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38843 } }
I20260812 01:18:02.909683 18776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4bce82228d4348b4ac346e109cf45f25. Latest consensus state: current_term: 1 leader_uuid: "4bce82228d4348b4ac346e109cf45f25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bce82228d4348b4ac346e109cf45f25" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38843 } } }
I20260812 01:18:02.909780 18776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:02.909940 18777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4bce82228d4348b4ac346e109cf45f25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bce82228d4348b4ac346e109cf45f25" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 38843 } } }
I20260812 01:18:02.910018 18789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:02.910110 18777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:02.910969 18789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:02.911158 18775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:02.904737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53130 (local address 127.17.183.190:38843)
0812 01:18:02.905002 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:02.905011 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:02.905047 (+ 36us) server_negotiation.cc:407] Connection header received
0812 01:18:02.905842 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:02.905852 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:02.905933 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:02.906091 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:02.906292 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.907783 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.908759 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:02.909389 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:02.909646 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:02.910311 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:02.910315 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:02.910315 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:02.910572 (+ 257us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:02.910614 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:02.910630 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:02.910693 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:02.910825 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 01:18:02.910918 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":99,"threads_started":1}
I20260812 01:18:02.912683 18789 catalog_manager.cc:1347] Generated new cluster ID: ea7161d08ccd465fafaa11b71370fcfa
I20260812 01:18:02.912746 18789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:02.947124 18789 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:02.947703 18789 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:02.954849 18789 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25: Generated new TSK 0
I20260812 01:18:02.955054 18789 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:02.965915 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38843
--builtin_ntp_servers=127.17.183.148:41391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:18:03.068195 18818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:03.068434 18818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:03.068470 18818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:03.069643 18818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:03.069708 18818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:03.069751 18818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:18:03.071110 18818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:03.071360 18818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:03.071659 18818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:03.077792 18828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:03.077756 18826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:03.077910 18825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:03.078095 18818 server_base.cc:1034] running on GCE node
I20260812 01:18:03.078276 18818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:03.078474 18818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:03.079612 18818 hybrid_clock.cc:648] HybridClock initialized: now 1786497483079602 us; error 31 us; skew 500 ppm
I20260812 01:18:03.080987 18818 webserver.cc:460] Webserver started at http://127.17.183.129:42791/ using document root <none> and password file <none>
I20260812 01:18:03.081266 18818 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:03.081316 18818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:03.081480 18818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:03.082540 18818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "c51612eb072e4bf4b1f995cfc5af380a"
format_stamp: "Formatted at 2026-08-12 01:18:03 on dist-test-slave-rwrg"
server_key: "b064ac0f48652b01740072cc91301d38"
server_key_iv: "ba5795bdab7ce720c23122f43902a67a"
server_key_version: "encryptionkey@0"
I20260812 01:18:03.082907 18818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "c51612eb072e4bf4b1f995cfc5af380a"
format_stamp: "Formatted at 2026-08-12 01:18:03 on dist-test-slave-rwrg"
server_key: "b064ac0f48652b01740072cc91301d38"
server_key_iv: "ba5795bdab7ce720c23122f43902a67a"
server_key_version: "encryptionkey@0"
I20260812 01:18:03.084226 18818 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:18:03.085059 18838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:03.085232 18818 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:03.085332 18818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "c51612eb072e4bf4b1f995cfc5af380a"
format_stamp: "Formatted at 2026-08-12 01:18:03 on dist-test-slave-rwrg"
server_key: "b064ac0f48652b01740072cc91301d38"
server_key_iv: "ba5795bdab7ce720c23122f43902a67a"
server_key_version: "encryptionkey@0"
I20260812 01:18:03.085413 18818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:03.098301 18818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:03.098611 18818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:03.098759 18818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:03.099000 18818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:03.099313 18818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:03.099364 18818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:03.099403 18818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:03.099427 18818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:03.105548 18818 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:40163
I20260812 01:18:03.105633 19046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:40163 every 8 connection(s)
I20260812 01:18:03.105962 18818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:18:03.111665 18775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.106699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:42765 (local address 127.17.183.190:38843)
0812 01:18:03.106764 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:03.106766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:03.107035 (+ 269us) server_negotiation.cc:407] Connection header received
0812 01:18:03.107594 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:03.107595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:03.107613 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:03.107684 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:03.108379 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.108992 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.110256 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.110468 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.110546 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.111418 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:03.111420 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:03.111420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:03.111424 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:03.111440 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:03.111444 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:03.111490 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:03.111582 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 01:18:03.111604 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 01:18:03.111922 19049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.106705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:38843 (local address 127.17.183.129:42765)
0812 01:18:03.106895 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:03.106928 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:03.107463 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:03.107761 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:03.107764 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:03.107773 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:03.108268 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.108273 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.109093 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.109095 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.110158 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.110161 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.110557 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.110558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.110695 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.111281 (+ 586us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:18:03.111281 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:03.111310 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:18:03.111332 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:03.111505 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:03.111510 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:03.111512 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:18:03.111565 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 01:18:03.111667 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260812 01:18:03.112504 19047 heartbeater.cc:347] Connected to a master server at 127.17.183.190:38843
I20260812 01:18:03.112598 19047 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:03.112761 19047 heartbeater.cc:511] Master 127.17.183.190:38843 requested a full tablet report, sending...
I20260812 01:18:03.113276 18706 ts_manager.cc:194] Registered new tserver with Master: c51612eb072e4bf4b1f995cfc5af380a (127.17.183.129:40163)
I20260812 01:18:03.113858 18706 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.129:42765
I20260812 01:18:03.114797 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 18818
I20260812 01:18:03.114881 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:18:03.115113 18142 external_mini_cluster.cc:1428] Setting key 9a4e8625624f012b5e2a58e6bb1a3712
I20260812 01:18:03.116010 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38843
--builtin_ntp_servers=127.17.183.148:41391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:18:03.201025 19051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:03.201242 19051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:03.201278 19051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:03.202364 19051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:03.202426 19051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:03.202469 19051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:18:03.203804 19051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:03.204051 19051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:03.204336 19051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:03.209455 19059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:03.209419 19056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:03.209674 19051 server_base.cc:1034] running on GCE node
W20260812 01:18:03.209419 19066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:03.209983 19051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:03.210247 19051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:03.211438 19051 hybrid_clock.cc:648] HybridClock initialized: now 1786497483211427 us; error 28 us; skew 500 ppm
I20260812 01:18:03.212714 19051 webserver.cc:460] Webserver started at http://127.17.183.130:38295/ using document root <none> and password file <none>
I20260812 01:18:03.212949 19051 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:03.213013 19051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:03.213161 19051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:03.214257 19051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "1bc315a2daa148978661d51d52578b6c"
format_stamp: "Formatted at 2026-08-12 01:18:03 on dist-test-slave-rwrg"
server_key: "5055bae3d09948d8861638321d909140"
server_key_iv: "05fa1c337aa10677c467a782b9f45239"
server_key_version: "encryptionkey@0"
I20260812 01:18:03.214654 19051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "1bc315a2daa148978661d51d52578b6c"
format_stamp: "Formatted at 2026-08-12 01:18:03 on dist-test-slave-rwrg"
server_key: "5055bae3d09948d8861638321d909140"
server_key_iv: "05fa1c337aa10677c467a782b9f45239"
server_key_version: "encryptionkey@0"
I20260812 01:18:03.215981 19051 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:03.216748 19081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:03.216919 19051 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:18:03.217003 19051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "1bc315a2daa148978661d51d52578b6c"
format_stamp: "Formatted at 2026-08-12 01:18:03 on dist-test-slave-rwrg"
server_key: "5055bae3d09948d8861638321d909140"
server_key_iv: "05fa1c337aa10677c467a782b9f45239"
server_key_version: "encryptionkey@0"
I20260812 01:18:03.217056 19051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:03.228173 19051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:03.228417 19051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:03.228586 19051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:03.228799 19051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:03.229054 19051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:03.229097 19051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:03.229118 19051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:03.229131 19051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:03.234992 19051 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:36145
I20260812 01:18:03.235102 19315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:36145 every 8 connection(s)
I20260812 01:18:03.235383 19051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:18:03.240661 18775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.236125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:51833 (local address 127.17.183.190:38843)
0812 01:18:03.236209 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:03.236212 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:03.236427 (+ 215us) server_negotiation.cc:407] Connection header received
0812 01:18:03.236980 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:03.236981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:03.236992 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:03.237057 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:03.237721 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.238206 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.239115 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.239290 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.239344 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.240175 (+ 831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:03.240176 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:03.240176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:03.240180 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:03.240194 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:03.240198 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:03.240255 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:03.240457 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 01:18:03.240481 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 01:18:03.240684 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.236092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:38843 (local address 127.17.183.130:51833)
0812 01:18:03.236305 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:03.236338 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:03.236881 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:03.237137 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:03.237140 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:03.237148 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:03.237631 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.237635 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.238286 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.238286 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.239034 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.239036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.239367 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.239368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.239474 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.239999 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:18:03.240000 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:03.240029 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:18:03.240052 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:03.240272 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:03.240277 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:03.240279 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:18:03.240339 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 01:18:03.240420 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":119,"threads_started":1}
I20260812 01:18:03.241257 19316 heartbeater.cc:347] Connected to a master server at 127.17.183.190:38843
I20260812 01:18:03.241369 19316 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:03.241526 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 19051
I20260812 01:18:03.241550 19316 heartbeater.cc:511] Master 127.17.183.190:38843 requested a full tablet report, sending...
I20260812 01:18:03.241641 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:18:03.241914 18142 external_mini_cluster.cc:1428] Setting key 7a7f90c9fab362f2ac3c121837babb6a
I20260812 01:18:03.242002 18706 ts_manager.cc:194] Registered new tserver with Master: 1bc315a2daa148978661d51d52578b6c (127.17.183.130:36145)
I20260812 01:18:03.242563 18706 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.130:51833
I20260812 01:18:03.243149 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38843
--builtin_ntp_servers=127.17.183.148:41391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:18:03.329074 19324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:03.329335 19324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:03.329373 19324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:03.330507 19324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:03.330577 19324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:03.330619 19324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:18:03.332012 19324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:38843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:03.332286 19324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:03.332616 19324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:03.337795 19331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:03.337802 19330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:03.337802 19334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:03.337832 19324 server_base.cc:1034] running on GCE node
I20260812 01:18:03.338243 19324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:03.338501 19324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:03.339650 19324 hybrid_clock.cc:648] HybridClock initialized: now 1786497483339639 us; error 33 us; skew 500 ppm
I20260812 01:18:03.340968 19324 webserver.cc:460] Webserver started at http://127.17.183.131:40989/ using document root <none> and password file <none>
I20260812 01:18:03.341233 19324 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:03.341279 19324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:03.341449 19324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:03.342502 19324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "77fb357ed9144abcbf1cf2044e3a27c1"
format_stamp: "Formatted at 2026-08-12 01:18:03 on dist-test-slave-rwrg"
server_key: "2e1aa3834b33668327ff186408af76fb"
server_key_iv: "a896ad2545e4a01c386376d026135dfe"
server_key_version: "encryptionkey@0"
I20260812 01:18:03.342855 19324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "77fb357ed9144abcbf1cf2044e3a27c1"
format_stamp: "Formatted at 2026-08-12 01:18:03 on dist-test-slave-rwrg"
server_key: "2e1aa3834b33668327ff186408af76fb"
server_key_iv: "a896ad2545e4a01c386376d026135dfe"
server_key_version: "encryptionkey@0"
I20260812 01:18:03.344146 19324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:18:03.344890 19343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:03.345065 19324 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:03.345175 19324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "77fb357ed9144abcbf1cf2044e3a27c1"
format_stamp: "Formatted at 2026-08-12 01:18:03 on dist-test-slave-rwrg"
server_key: "2e1aa3834b33668327ff186408af76fb"
server_key_iv: "a896ad2545e4a01c386376d026135dfe"
server_key_version: "encryptionkey@0"
I20260812 01:18:03.345249 19324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:03.357903 19324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:03.358209 19324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:03.358353 19324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:03.358582 19324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:03.358925 19324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:03.358989 19324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:03.359030 19324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:03.359057 19324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:03.364997 19324 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:36471
I20260812 01:18:03.365056 19575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:36471 every 8 connection(s)
I20260812 01:18:03.365502 19324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:18:03.368978 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 19324
I20260812 01:18:03.369096 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:18:03.369320 18142 external_mini_cluster.cc:1428] Setting key 043089a961194ca90dd5324e22855cd1
I20260812 01:18:03.372078 18775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.367292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:46685 (local address 127.17.183.190:38843)
0812 01:18:03.367364 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:03.367366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:03.367623 (+ 257us) server_negotiation.cc:407] Connection header received
0812 01:18:03.368161 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:03.368162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:03.368179 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:03.368230 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:03.368936 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.369601 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.370858 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.371036 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.371092 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.371893 (+ 801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:03.371894 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:03.371894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:03.371898 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:03.371907 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:03.371910 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:03.371940 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:03.372006 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 01:18:03.372022 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 01:18:03.372294 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.367267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:38843 (local address 127.17.183.131:46685)
0812 01:18:03.367488 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:03.367520 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:03.368043 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:03.368299 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:03.368302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:03.368311 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:03.368846 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.368852 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.369718 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.369719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.370787 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.370790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.371109 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.371109 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.371214 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.371775 (+ 561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:18:03.371775 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:03.371804 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:18:03.371826 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:03.371949 (+ 123us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:03.371952 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:03.371954 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:18:03.371996 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 01:18:03.372068 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":100,"threads_started":1}
I20260812 01:18:03.372748 19576 heartbeater.cc:347] Connected to a master server at 127.17.183.190:38843
I20260812 01:18:03.372859 19576 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:03.373042 19576 heartbeater.cc:511] Master 127.17.183.190:38843 requested a full tablet report, sending...
I20260812 01:18:03.373438 18702 ts_manager.cc:194] Registered new tserver with Master: 77fb357ed9144abcbf1cf2044e3a27c1 (127.17.183.131:36471)
I20260812 01:18:03.373775 18702 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.131:46685
I20260812 01:18:03.381228 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:18:03.385522 18775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.382644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53144 (local address 127.17.183.190:38843)
0812 01:18:03.382699 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:03.382701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:03.382807 (+ 106us) server_negotiation.cc:407] Connection header received
0812 01:18:03.382887 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:03.382888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:03.382898 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:03.382967 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:03.383155 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.383619 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.384377 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.384630 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.384705 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.385291 (+ 586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:03.385293 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:03.385293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:03.385298 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:03.385311 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:03.385315 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:03.385362 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:03.385418 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 01:18:03.385439 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 01:18:03.386986 18702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:18:03.388645 18702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:18:03.395140 19594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.390854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:40163 (local address 127.0.0.1:57418)
0812 01:18:03.391252 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:03.391282 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:03.391336 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:03.391686 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:03.391689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:03.391691 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:03.391753 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.391755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.392752 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.392753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.394111 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.394114 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.394849 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.394850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.394923 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.394935 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 01:18:03.395012 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 01:18:03.395066 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":62,"threads_started":1}
I20260812 01:18:03.395154 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.391055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57418 (local address 127.17.183.129:40163)
0812 01:18:03.391388 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:03.391392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:03.391402 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:18:03.391446 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:03.391464 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:03.391477 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:03.391571 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:03.391838 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.392667 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.394200 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.394759 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.394851 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.394944 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:03.395025 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 01:18:03.395066 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":84,"threads_started":1}
I20260812 01:18:03.395336 19593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.390854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:36145 (local address 127.0.0.1:55008)
0812 01:18:03.391401 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:03.391408 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:03.391434 (+ 26us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:03.391880 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:03.391880 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:03.391883 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:03.391918 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.391919 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.393322 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.393330 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.394138 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.394141 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.395099 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.395100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.395164 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.395168 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:03.395200 (+ 32us) client_negotiation.cc:240] Negotiation successful
0812 01:18:03.395256 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"mutex_wait_us":1,"thread_start_us":58,"threads_started":1}
I20260812 01:18:03.395430 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.391054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:36471 (local address 127.0.0.1:38628)
0812 01:18:03.391540 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:03.391549 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:03.391594 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:03.391853 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:03.391854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:03.391857 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:03.391910 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.391912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.393233 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.393234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.394251 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.394253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.395182 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.395183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.395235 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.395238 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:18:03.395285 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 01:18:03.395320 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":84,"threads_started":1}
I20260812 01:18:03.395529 19598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.391160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38628 (local address 127.17.183.131:36471)
0812 01:18:03.391338 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:03.391343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:03.391599 (+ 256us) server_negotiation.cc:407] Connection header received
0812 01:18:03.391669 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:03.391672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:03.391689 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:03.391778 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:03.391996 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.393137 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.394318 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.394994 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.395069 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.395150 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:03.395382 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 01:18:03.395428 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260812 01:18:03.395787 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.390970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55008 (local address 127.17.183.130:36145)
0812 01:18:03.391736 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:03.391741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:03.391751 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:18:03.391789 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:03.391791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:03.391805 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:03.391881 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:03.392004 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.393183 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.394246 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.394989 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.395540 (+ 551us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.395639 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:03.395664 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 01:18:03.395703 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":130,"threads_started":1}
I20260812 01:18:03.396296 19434 tablet_service.cc:1467] Processing CreateTablet for tablet 5782e46afd8948a896e5c88eff1851b0 (DEFAULT_TABLE table=test-table [id=864b4bd7d0e441d7ae38508e8916eff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:03.396384 18915 tablet_service.cc:1467] Processing CreateTablet for tablet 5782e46afd8948a896e5c88eff1851b0 (DEFAULT_TABLE table=test-table [id=864b4bd7d0e441d7ae38508e8916eff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:03.396597 19177 tablet_service.cc:1467] Processing CreateTablet for tablet 5782e46afd8948a896e5c88eff1851b0 (DEFAULT_TABLE table=test-table [id=864b4bd7d0e441d7ae38508e8916eff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:03.396741 18915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5782e46afd8948a896e5c88eff1851b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:03.396751 19434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5782e46afd8948a896e5c88eff1851b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:03.396991 19177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5782e46afd8948a896e5c88eff1851b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:03.399698 19599 tablet_bootstrap.cc:492] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: Bootstrap starting.
I20260812 01:18:03.400511 19599 tablet_bootstrap.cc:654] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:03.400511 19602 tablet_bootstrap.cc:492] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: Bootstrap starting.
I20260812 01:18:03.400763 19600 tablet_bootstrap.cc:492] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a: Bootstrap starting.
I20260812 01:18:03.400892 19599 log.cc:824] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:03.401439 19600 tablet_bootstrap.cc:654] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:03.401684 19599 tablet_bootstrap.cc:492] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: No bootstrap required, opened a new log
I20260812 01:18:03.401763 19599 ts_tablet_manager.cc:1397] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:18:03.401777 19600 log.cc:824] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:03.402546 19602 tablet_bootstrap.cc:654] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:03.402908 19602 log.cc:824] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:03.403544 19600 tablet_bootstrap.cc:492] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a: No bootstrap required, opened a new log
I20260812 01:18:03.403618 19600 ts_tablet_manager.cc:1397] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 01:18:03.403673 19602 tablet_bootstrap.cc:492] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: No bootstrap required, opened a new log
I20260812 01:18:03.403744 19602 ts_tablet_manager.cc:1397] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 01:18:03.404816 19599 raft_consensus.cc:348] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51612eb072e4bf4b1f995cfc5af380a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 40163 } } peers { permanent_uuid: "1bc315a2daa148978661d51d52578b6c" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 36145 } } peers { permanent_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36471 } }
I20260812 01:18:03.404994 19599 raft_consensus.cc:374] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:03.405035 19599 raft_consensus.cc:729] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bc315a2daa148978661d51d52578b6c, State: Initialized, Role: FOLLOWER
I20260812 01:18:03.405180 19599 consensus_queue.cc:260] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51612eb072e4bf4b1f995cfc5af380a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 40163 } } peers { permanent_uuid: "1bc315a2daa148978661d51d52578b6c" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 36145 } } peers { permanent_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36471 } }
I20260812 01:18:03.405449 19599 ts_tablet_manager.cc:1428] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260812 01:18:03.405606 19316 heartbeater.cc:503] Master 127.17.183.190:38843 was elected leader, sending a full tablet report...
I20260812 01:18:03.406181 19602 raft_consensus.cc:348] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51612eb072e4bf4b1f995cfc5af380a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 40163 } } peers { permanent_uuid: "1bc315a2daa148978661d51d52578b6c" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 36145 } } peers { permanent_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36471 } }
I20260812 01:18:03.406270 19600 raft_consensus.cc:348] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51612eb072e4bf4b1f995cfc5af380a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 40163 } } peers { permanent_uuid: "1bc315a2daa148978661d51d52578b6c" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 36145 } } peers { permanent_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36471 } }
I20260812 01:18:03.406373 19602 raft_consensus.cc:374] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:03.406458 19602 raft_consensus.cc:729] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77fb357ed9144abcbf1cf2044e3a27c1, State: Initialized, Role: FOLLOWER
I20260812 01:18:03.406459 19600 raft_consensus.cc:374] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:03.406500 19600 raft_consensus.cc:729] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51612eb072e4bf4b1f995cfc5af380a, State: Initialized, Role: FOLLOWER
I20260812 01:18:03.406572 19602 consensus_queue.cc:260] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51612eb072e4bf4b1f995cfc5af380a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 40163 } } peers { permanent_uuid: "1bc315a2daa148978661d51d52578b6c" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 36145 } } peers { permanent_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36471 } }
I20260812 01:18:03.406629 19600 consensus_queue.cc:260] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51612eb072e4bf4b1f995cfc5af380a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 40163 } } peers { permanent_uuid: "1bc315a2daa148978661d51d52578b6c" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 36145 } } peers { permanent_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36471 } }
I20260812 01:18:03.406832 19602 ts_tablet_manager.cc:1428] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260812 01:18:03.406919 19600 ts_tablet_manager.cc:1428] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 01:18:03.406968 19576 heartbeater.cc:503] Master 127.17.183.190:38843 was elected leader, sending a full tablet report...
I20260812 01:18:03.407054 19047 heartbeater.cc:503] Master 127.17.183.190:38843 was elected leader, sending a full tablet report...
W20260812 01:18:03.485950 19319 tablet.cc:2369] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:18:03.606684 19048 tablet.cc:2369] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:18:03.616287 19577 tablet.cc:2369] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:18:03.683185 19606 raft_consensus.cc:482] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:18:03.683336 19606 raft_consensus.cc:504] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51612eb072e4bf4b1f995cfc5af380a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 40163 } } peers { permanent_uuid: "1bc315a2daa148978661d51d52578b6c" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 36145 } } peers { permanent_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36471 } }
I20260812 01:18:03.683816 19606 leader_election.cc:288] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51612eb072e4bf4b1f995cfc5af380a (127.17.183.129:40163), 77fb357ed9144abcbf1cf2044e3a27c1 (127.17.183.131:36471)
I20260812 01:18:03.686898 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.684115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:56859 (local address 127.17.183.129:40163)
0812 01:18:03.684198 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:03.684200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:03.684210 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:18:03.684254 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:03.684255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:03.684281 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:03.684388 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:03.684622 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.685160 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.686169 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.686541 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.686597 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.686604 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:03.686780 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 01:18:03.686823 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 01:18:03.686946 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.684023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:40163 (local address 127.17.183.130:56859)
0812 01:18:03.684092 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:03.684105 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:03.684153 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:03.684399 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:03.684400 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:03.684402 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:03.684512 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.684514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.685236 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.685237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.686061 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.686064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.686623 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.686625 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.686699 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.686708 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 01:18:03.686751 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 01:18:03.686841 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":36}
I20260812 01:18:03.686990 19598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.684251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:52449 (local address 127.17.183.131:36471)
0812 01:18:03.684300 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:03.684302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:03.684456 (+ 154us) server_negotiation.cc:407] Connection header received
0812 01:18:03.684513 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:03.684514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:03.684524 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:03.684627 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:03.684772 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.685265 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.686204 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.686554 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.686651 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.686659 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:03.686869 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 01:18:03.686915 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 01:18:03.687093 19609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.684145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:36471 (local address 127.17.183.130:52449)
0812 01:18:03.684360 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:03.684371 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:03.684434 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:03.684632 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:03.684633 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:03.684634 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:03.684702 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.684703 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.685346 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.685347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.686089 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:03.686091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.686677 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.686678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:03.686787 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.686791 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:03.686846 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 01:18:03.686882 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":1,"thread_start_us":121,"threads_started":1}
I20260812 01:18:03.687376 18955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5782e46afd8948a896e5c88eff1851b0" candidate_uuid: "1bc315a2daa148978661d51d52578b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51612eb072e4bf4b1f995cfc5af380a" is_pre_election: true
I20260812 01:18:03.687395 19475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5782e46afd8948a896e5c88eff1851b0" candidate_uuid: "1bc315a2daa148978661d51d52578b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" is_pre_election: true
I20260812 01:18:03.687539 18955 raft_consensus.cc:2454] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bc315a2daa148978661d51d52578b6c in term 0.
I20260812 01:18:03.687539 19475 raft_consensus.cc:2454] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bc315a2daa148978661d51d52578b6c in term 0.
I20260812 01:18:03.687800 19088 leader_election.cc:302] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bc315a2daa148978661d51d52578b6c, 77fb357ed9144abcbf1cf2044e3a27c1; no voters:
I20260812 01:18:03.687928 19606 raft_consensus.cc:2781] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:18:03.688022 19606 raft_consensus.cc:482] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:18:03.688058 19606 raft_consensus.cc:3037] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:03.688941 19606 raft_consensus.cc:504] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51612eb072e4bf4b1f995cfc5af380a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 40163 } } peers { permanent_uuid: "1bc315a2daa148978661d51d52578b6c" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 36145 } } peers { permanent_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36471 } }
I20260812 01:18:03.689090 19606 leader_election.cc:288] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [CANDIDATE]: Term 1 election: Requested vote from peers c51612eb072e4bf4b1f995cfc5af380a (127.17.183.129:40163), 77fb357ed9144abcbf1cf2044e3a27c1 (127.17.183.131:36471)
I20260812 01:18:03.689276 18955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5782e46afd8948a896e5c88eff1851b0" candidate_uuid: "1bc315a2daa148978661d51d52578b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51612eb072e4bf4b1f995cfc5af380a"
I20260812 01:18:03.689328 19475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5782e46afd8948a896e5c88eff1851b0" candidate_uuid: "1bc315a2daa148978661d51d52578b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77fb357ed9144abcbf1cf2044e3a27c1"
I20260812 01:18:03.689363 18955 raft_consensus.cc:3037] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:03.689412 19475 raft_consensus.cc:3037] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:03.690124 18955 raft_consensus.cc:2454] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bc315a2daa148978661d51d52578b6c in term 1.
I20260812 01:18:03.690207 19475 raft_consensus.cc:2454] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bc315a2daa148978661d51d52578b6c in term 1.
I20260812 01:18:03.690351 19088 leader_election.cc:302] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bc315a2daa148978661d51d52578b6c, c51612eb072e4bf4b1f995cfc5af380a; no voters:
I20260812 01:18:03.690469 19606 raft_consensus.cc:2781] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:03.690635 19606 raft_consensus.cc:686] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 1 LEADER]: Becoming Leader. State: Replica: 1bc315a2daa148978661d51d52578b6c, State: Running, Role: LEADER
I20260812 01:18:03.690743 19606 consensus_queue.cc:237] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51612eb072e4bf4b1f995cfc5af380a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 40163 } } peers { permanent_uuid: "1bc315a2daa148978661d51d52578b6c" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 36145 } } peers { permanent_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36471 } }
I20260812 01:18:03.691608 18706 catalog_manager.cc:5495] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bc315a2daa148978661d51d52578b6c (127.17.183.130). New cstate: current_term: 1 leader_uuid: "1bc315a2daa148978661d51d52578b6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51612eb072e4bf4b1f995cfc5af380a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bc315a2daa148978661d51d52578b6c" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 36145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36471 } health_report { overall_health: UNKNOWN } } }
I20260812 01:18:03.747913 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.745557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55012 (local address 127.17.183.130:36145)
0812 01:18:03.745624 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:03.745626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:03.745635 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:18:03.745691 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:03.745692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:03.745713 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:03.745782 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:03.745905 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.746384 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.747128 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:03.747314 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:03.747364 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:03.747534 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:03.747641 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:03.747706 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:03.747792 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 01:18:03.747816 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 01:18:03.749897 19475 raft_consensus.cc:1261] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1 [term 1 FOLLOWER]: Refusing update from remote peer 1bc315a2daa148978661d51d52578b6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:03.749897 18955 raft_consensus.cc:1261] T 5782e46afd8948a896e5c88eff1851b0 P c51612eb072e4bf4b1f995cfc5af380a [term 1 FOLLOWER]: Refusing update from remote peer 1bc315a2daa148978661d51d52578b6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:03.750259 19610 consensus_queue.cc:1035] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "77fb357ed9144abcbf1cf2044e3a27c1" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:03.750424 19606 consensus_queue.cc:1035] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51612eb072e4bf4b1f995cfc5af380a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:03.753328 19618 mvcc.cc:205] Tried to move back new op lower bound from 7317493693436575744 to 7317493693197918208. Current Snapshot: MvccSnapshot[applied={T|T < 7317493693436575744 or (T in {7317493693436575744})}]
I20260812 01:18:03.753968 19619 mvcc.cc:205] Tried to move back new op lower bound from 7317493693436575744 to 7317493693197918208. Current Snapshot: MvccSnapshot[applied={T|T < 7317493693436575744 or (T in {7317493693436575744})}]
I20260812 01:18:03.754598 19620 mvcc.cc:205] Tried to move back new op lower bound from 7317493693436575744 to 7317493693197918208. Current Snapshot: MvccSnapshot[applied={T|T < 7317493693436575744}]
I20260812 01:18:03.755589 18706 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:03.755682 18706 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:03.756477 18706 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4bce82228d4348b4ac346e109cf45f25: Sending DeleteTablet for 3 replicas of tablet 5782e46afd8948a896e5c88eff1851b0
I20260812 01:18:03.756825 18915 tablet_service.cc:1514] Processing DeleteTablet for tablet 5782e46afd8948a896e5c88eff1851b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:03 UTC) from {username='slave'} at 127.0.0.1:57418
I20260812 01:18:03.756940 19434 tablet_service.cc:1514] Processing DeleteTablet for tablet 5782e46afd8948a896e5c88eff1851b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:03 UTC) from {username='slave'} at 127.0.0.1:38628
I20260812 01:18:03.756960 19177 tablet_service.cc:1514] Processing DeleteTablet for tablet 5782e46afd8948a896e5c88eff1851b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:03 UTC) from {username='slave'} at 127.0.0.1:55008
I20260812 01:18:03.757143 19636 tablet_replica.cc:330] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: stopping tablet replica
I20260812 01:18:03.757263 19636 raft_consensus.cc:2229] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:18:03.757323 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 18818
I20260812 01:18:03.767508 19636 raft_consensus.cc:2258] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:03.768150 19636 ts_tablet_manager.cc:1905] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:03.770056 19637 tablet_replica.cc:330] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: stopping tablet replica
I20260812 01:18:03.770187 19637 raft_consensus.cc:2229] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:18:03.770303 19637 raft_consensus.cc:2258] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:03.771762 19637 ts_tablet_manager.cc:1905] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:03.771896 19636 ts_tablet_manager.cc:1918] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:03.772004 19636 log.cc:1196] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/5782e46afd8948a896e5c88eff1851b0
I20260812 01:18:03.772289 19636 ts_tablet_manager.cc:1939] T 5782e46afd8948a896e5c88eff1851b0 P 77fb357ed9144abcbf1cf2044e3a27c1: Deleting consensus metadata
I20260812 01:18:03.772822 18675 catalog_manager.cc:4841] TS 77fb357ed9144abcbf1cf2044e3a27c1 (127.17.183.131:36471): tablet 5782e46afd8948a896e5c88eff1851b0 (table test-table [id=864b4bd7d0e441d7ae38508e8916eff6]) successfully deleted
I20260812 01:18:03.773516 19637 ts_tablet_manager.cc:1918] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:03.773612 19637 log.cc:1196] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/5782e46afd8948a896e5c88eff1851b0
I20260812 01:18:03.773859 19637 ts_tablet_manager.cc:1939] T 5782e46afd8948a896e5c88eff1851b0 P 1bc315a2daa148978661d51d52578b6c: Deleting consensus metadata
I20260812 01:18:03.774293 18672 catalog_manager.cc:4841] TS 1bc315a2daa148978661d51d52578b6c (127.17.183.130:36145): tablet 5782e46afd8948a896e5c88eff1851b0 (table test-table [id=864b4bd7d0e441d7ae38508e8916eff6]) successfully deleted
W20260812 01:18:03.777693 18675 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:40163 (error 108)
I20260812 01:18:03.777942 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 19051
I20260812 01:18:03.780823 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:03.778070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:40163 (local address 127.0.0.1:57430)
0812 01:18:03.780726 (+ 2656us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:03.780791 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:40163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2632}
W20260812 01:18:03.784718 18675 catalog_manager.cc:4584] TS c51612eb072e4bf4b1f995cfc5af380a (127.17.183.129:40163): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5782e46afd8948a896e5c88eff1851b0: Network error: Client connection negotiation failed: client connection to 127.17.183.129:40163: connect: Connection refused (error 111)
I20260812 01:18:03.789669 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 19324
I20260812 01:18:03.800273 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 18644
2026-08-12T01:18:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1071 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:03 dist-test-slave-rwrg krb5kdc[19645](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:03 dist-test-slave-rwrg krb5kdc[19645](info): set up 2 sockets
Aug 12 01:18:03 dist-test-slave-rwrg krb5kdc[19645](info): commencing operation
krb5kdc: starting...
W20260812 01:18:05.118441 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:05 dist-test-slave-rwrg krb5kdc[19645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:18:05.237579 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:36791
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:36791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:05.324478 19672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:05.324707 19672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:05.324730 19672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:05.325790 19672 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:05.325830 19672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:05.325845 19672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:05.325857 19672 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:05.325870 19672 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:05.327272 19672 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:36791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:36791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:05.327456 19672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:05.327626 19672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:05.332729 19686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:05.332827 19672 server_base.cc:1034] running on GCE node
W20260812 01:18:05.332728 19683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:05.332736 19689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:05.333174 19672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:05.333431 19672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:05.334573 19672 hybrid_clock.cc:648] HybridClock initialized: now 1786497485334553 us; error 46 us; skew 500 ppm
Aug 12 01:18:05 dist-test-slave-rwrg krb5kdc[19645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:05.341645 19672 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:18:05.342097 19672 webserver.cc:460] Webserver started at http://127.17.183.190:39659/ using document root <none> and password file <none>
I20260812 01:18:05.342353 19672 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:05.342401 19672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:05.342549 19672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:05.343634 19672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "63a7112f3a9f42b3a04cfaee9ad8e4e4"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "b6512f7dc84d5be83977c36f5471e2b9"
server_key_iv: "e2fdc456bbe7be331d2f1df4a5c5c314"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.344007 19672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "63a7112f3a9f42b3a04cfaee9ad8e4e4"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "b6512f7dc84d5be83977c36f5471e2b9"
server_key_iv: "e2fdc456bbe7be331d2f1df4a5c5c314"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.345461 19672 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:05.346215 19701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:05.346402 19672 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:05.346491 19672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "63a7112f3a9f42b3a04cfaee9ad8e4e4"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "b6512f7dc84d5be83977c36f5471e2b9"
server_key_iv: "e2fdc456bbe7be331d2f1df4a5c5c314"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.346566 19672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:05.362178 19672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:05.364023 19672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:05.364181 19672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:05.368363 19672 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:36791
I20260812 01:18:05.368396 19788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:36791 every 8 connection(s)
I20260812 01:18:05.368798 19672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:05.369761 19789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:05.372009 19789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4: Bootstrap starting.
I20260812 01:18:05.372290 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 19672
I20260812 01:18:05.372419 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:05.372623 18142 external_mini_cluster.cc:1428] Setting key 9c7b0557e26771c2135de9457e5bc893
I20260812 01:18:05.372777 19789 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:05.373106 19789 log.cc:824] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:05.373819 19789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4: No bootstrap required, opened a new log
I20260812 01:18:05.376184 19789 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a7112f3a9f42b3a04cfaee9ad8e4e4" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36791 } }
I20260812 01:18:05.376362 19789 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:05.376396 19789 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a7112f3a9f42b3a04cfaee9ad8e4e4, State: Initialized, Role: FOLLOWER
I20260812 01:18:05.376528 19789 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a7112f3a9f42b3a04cfaee9ad8e4e4" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36791 } }
I20260812 01:18:05.376611 19789 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:05.376638 19789 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:05.376682 19789 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:05.377242 19789 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a7112f3a9f42b3a04cfaee9ad8e4e4" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36791 } }
I20260812 01:18:05.377331 19789 leader_election.cc:302] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63a7112f3a9f42b3a04cfaee9ad8e4e4; no voters:
I20260812 01:18:05.377521 19789 leader_election.cc:288] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:05.377561 19797 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:05.377724 19797 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [term 1 LEADER]: Becoming Leader. State: Replica: 63a7112f3a9f42b3a04cfaee9ad8e4e4, State: Running, Role: LEADER
I20260812 01:18:05.377801 19789 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:05.377823 19797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a7112f3a9f42b3a04cfaee9ad8e4e4" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36791 } }
I20260812 01:18:05.378162 19797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63a7112f3a9f42b3a04cfaee9ad8e4e4. Latest consensus state: current_term: 1 leader_uuid: "63a7112f3a9f42b3a04cfaee9ad8e4e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a7112f3a9f42b3a04cfaee9ad8e4e4" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36791 } } }
I20260812 01:18:05.378253 19797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:05.378172 19798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63a7112f3a9f42b3a04cfaee9ad8e4e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a7112f3a9f42b3a04cfaee9ad8e4e4" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 36791 } } }
I20260812 01:18:05.378396 19798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4 [sys.catalog]: This master's current role is: LEADER
W20260812 01:18:05.379769 19824 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:18:05.379819 19824 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 12 01:18:05 dist-test-slave-rwrg krb5kdc[19645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:05.379863 19808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:05.380038 19808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:05.382032 19808 catalog_manager.cc:1347] Generated new cluster ID: aa23083dfd6f4f8580d2398d26658046
I20260812 01:18:05.382093 19808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:05.384264 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.373181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35204 (local address 127.17.183.190:36791)
0812 01:18:05.373370 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:05.373379 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:05.373413 (+ 34us) server_negotiation.cc:407] Connection header received
0812 01:18:05.373881 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:05.373888 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:05.373969 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:05.374109 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:05.374903 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.375776 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.376864 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.377290 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.377444 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.380414 (+ 2970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:05.380418 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:05.380418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:05.380430 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:05.382615 (+ 2185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:05.383039 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:05.383042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:05.383043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:05.383144 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:05.383373 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:05.383374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:05.383374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:05.383658 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:05.383804 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:05.383939 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 01:18:05.384058 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":79,"threads_started":1}
I20260812 01:18:05.393719 19808 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:05.394424 19808 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:05.401355 19808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4: Generated new TSK 0
I20260812 01:18:05.401535 19808 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:18:05.433630 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36791
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:05.526415 19832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:05.526701 19832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:05.526731 19832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:05.527843 19832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:05.527878 19832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:05.527904 19832 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:18:05.529593 19832 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:05.529798 19832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:05.529989 19832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:05.534871 19838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:05.534938 19840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:05.535136 19832 server_base.cc:1034] running on GCE node
W20260812 01:18:05.534883 19845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:05.535416 19832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:05.535660 19832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:05.536801 19832 hybrid_clock.cc:648] HybridClock initialized: now 1786497485536792 us; error 31 us; skew 500 ppm
Aug 12 01:18:05 dist-test-slave-rwrg krb5kdc[19645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:05.539407 19832 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:18:05.539877 19832 webserver.cc:460] Webserver started at http://127.17.183.129:40725/ using document root <none> and password file <none>
I20260812 01:18:05.540113 19832 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:05.540182 19832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:05.540351 19832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:05.541465 19832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "a873aa82ec234f9ba662d2ed4dc5a59a"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "5d685e4bf6b0aa79e7fc2819fb342991"
server_key_iv: "3941b156170fd771644357326a6db394"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.541831 19832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "a873aa82ec234f9ba662d2ed4dc5a59a"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "5d685e4bf6b0aa79e7fc2819fb342991"
server_key_iv: "3941b156170fd771644357326a6db394"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.543268 19832 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:18:05.543967 19854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:05.544158 19832 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:05.544279 19832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "a873aa82ec234f9ba662d2ed4dc5a59a"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "5d685e4bf6b0aa79e7fc2819fb342991"
server_key_iv: "3941b156170fd771644357326a6db394"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.544355 19832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:05.553746 19832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:05.555598 19832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:05.555763 19832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:05.556015 19832 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:05.556330 19832 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:05.556388 19832 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:05.556428 19832 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:05.556452 19832 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:05.562494 19832 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:41181
I20260812 01:18:05.562544 20069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:41181 every 8 connection(s)
I20260812 01:18:05.562888 19832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
Aug 12 01:18:05 dist-test-slave-rwrg krb5kdc[19645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:05.569011 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 19832
I20260812 01:18:05.569136 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:18:05.569356 18142 external_mini_cluster.cc:1428] Setting key 77427461dc9a8053cdd60233d11e03bb
I20260812 01:18:05.572276 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.563614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:60745 (local address 127.17.183.190:36791)
0812 01:18:05.563676 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:05.563678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:05.563880 (+ 202us) server_negotiation.cc:407] Connection header received
0812 01:18:05.564341 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:05.564342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:05.564351 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:05.564408 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:05.565397 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.565902 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.566833 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.567082 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.567136 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.569271 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:05.569272 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:05.569273 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:05.569279 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:05.570955 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:05.571327 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:05.571328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:05.571329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:05.571394 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:05.571638 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:05.571639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:05.571640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:05.571785 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:05.571852 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:05.572102 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 01:18:05.572188 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 01:18:05.572445 20077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.563561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36791 (local address 127.17.183.129:60745)
0812 01:18:05.563755 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:05.563795 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:05.564260 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:05.564457 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:05.564460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:05.565105 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:05.565304 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.565309 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.565996 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.565997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.566754 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.566755 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.567159 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.567160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.567255 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.567681 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:05.567689 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:05.569130 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:05.571040 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:05.571046 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:05.571048 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:05.571254 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:05.571459 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:05.571460 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:05.571460 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:05.571567 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:05.571850 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:05.571855 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:05.571960 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 01:18:05.572066 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 01:18:05.572216 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
I20260812 01:18:05.573002 20071 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36791
I20260812 01:18:05.573096 20071 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:05.573278 20071 heartbeater.cc:511] Master 127.17.183.190:36791 requested a full tablet report, sending...
I20260812 01:18:05.573807 19739 ts_manager.cc:194] Registered new tserver with Master: a873aa82ec234f9ba662d2ed4dc5a59a (127.17.183.129:41181)
I20260812 01:18:05.574736 19739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:60745
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:18:05.595155 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36791
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:05.677311 20083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:05.677502 20083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:05.677525 20083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:05.678736 20083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:05.678778 20083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:05.678805 20083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:18:05.680209 20083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:05.680384 20083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:05.680570 20083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:05.685377 20099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:05.685391 20100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:05.685616 20083 server_base.cc:1034] running on GCE node
W20260812 01:18:05.685391 20104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:05.685909 20083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:05.686105 20083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:05.687253 20083 hybrid_clock.cc:648] HybridClock initialized: now 1786497485687239 us; error 31 us; skew 500 ppm
Aug 12 01:18:05 dist-test-slave-rwrg krb5kdc[19645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:05.689919 20083 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:18:05.690383 20083 webserver.cc:460] Webserver started at http://127.17.183.130:36533/ using document root <none> and password file <none>
I20260812 01:18:05.690621 20083 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:05.690690 20083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:05.690843 20083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:05.691828 20083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "a8f66f22a881492088aa05a0d16dc297"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "279a8eb80146a9925bb9df3bc663b46d"
server_key_iv: "d2fb33879509f8da12b1d40652a46532"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.692189 20083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "a8f66f22a881492088aa05a0d16dc297"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "279a8eb80146a9925bb9df3bc663b46d"
server_key_iv: "d2fb33879509f8da12b1d40652a46532"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.693594 20083 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 01:18:05.694330 20116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:05.694509 20083 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:05.694633 20083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "a8f66f22a881492088aa05a0d16dc297"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "279a8eb80146a9925bb9df3bc663b46d"
server_key_iv: "d2fb33879509f8da12b1d40652a46532"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.694741 20083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:05.739188 20083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:05.741730 20083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:05.741895 20083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:05.742154 20083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:05.742503 20083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:05.742558 20083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:05.742628 20083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:05.742652 20083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:05.749006 20083 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:42307
I20260812 01:18:05.749058 20323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:42307 every 8 connection(s)
I20260812 01:18:05.749465 20083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:18:05.750430 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 20083
I20260812 01:18:05.750571 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:18:05.750757 18142 external_mini_cluster.cc:1428] Setting key 0db0a4922b6c83b87193f511ec499e47
Aug 12 01:18:05 dist-test-slave-rwrg krb5kdc[19645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:05.759011 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.750188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:37083 (local address 127.17.183.190:36791)
0812 01:18:05.750246 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:05.750248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:05.750495 (+ 247us) server_negotiation.cc:407] Connection header received
0812 01:18:05.751125 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:05.751126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:05.751139 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:05.751198 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:05.752195 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.752747 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.753811 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.754008 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.754094 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.756179 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:05.756181 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:05.756181 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:05.756189 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:05.757612 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:05.758050 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:05.758051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:05.758052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:05.758113 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:05.758365 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:05.758366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:05.758366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:05.758476 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:05.758550 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:05.758841 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 01:18:05.758921 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 01:18:05.759238 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.750147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36791 (local address 127.17.183.130:37083)
0812 01:18:05.750322 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:05.750389 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:05.751034 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:05.751268 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:05.751272 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:05.751911 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:05.752096 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.752101 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.752839 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.752841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.753703 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.753706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.754094 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.754095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.754231 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.754712 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:05.754737 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:05.756087 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:05.757707 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:05.757732 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:05.757734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:05.757958 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:05.758186 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:05.758187 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:05.758187 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:05.758292 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:05.758541 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:05.758548 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:05.758710 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 01:18:05.758817 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 01:18:05.758967 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":103,"threads_started":1}
I20260812 01:18:05.759680 20324 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36791
I20260812 01:18:05.759792 20324 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
I20260812 01:18:05.759999 20324 heartbeater.cc:511] Master 127.17.183.190:36791 requested a full tablet report, sending...
I20260812 01:18:05.760421 19739 ts_manager.cc:194] Registered new tserver with Master: a8f66f22a881492088aa05a0d16dc297 (127.17.183.130:42307)
I20260812 01:18:05.760798 19739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:37083
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:18:05.777196 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36791
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:38303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:05.861356 20330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:05.861567 20330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:05.861591 20330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:05.862776 20330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:05.862821 20330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:05.862847 20330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:18:05.864253 20330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:38303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:36791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:05.864456 20330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:05.864660 20330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:05.869805 20345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:05.869815 20341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:05.869976 20330 server_base.cc:1034] running on GCE node
W20260812 01:18:05.869875 20337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:05.870229 20330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:05.870481 20330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:05.871657 20330 hybrid_clock.cc:648] HybridClock initialized: now 1786497485871641 us; error 27 us; skew 500 ppm
Aug 12 01:18:05 dist-test-slave-rwrg krb5kdc[19645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:05.874367 20330 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:18:05.874884 20330 webserver.cc:460] Webserver started at http://127.17.183.131:38029/ using document root <none> and password file <none>
I20260812 01:18:05.875128 20330 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:05.875197 20330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:05.875361 20330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:05.876387 20330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "3e034e10339f4a45ad4b17e520a330dd"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "43e3a5bb880365364ffe474e67b1769d"
server_key_iv: "efda8848564ed60d429ac79333059aef"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.876837 20330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "3e034e10339f4a45ad4b17e520a330dd"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "43e3a5bb880365364ffe474e67b1769d"
server_key_iv: "efda8848564ed60d429ac79333059aef"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.878376 20330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:18:05.879272 20354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:05.879451 20330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:05.879566 20330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "3e034e10339f4a45ad4b17e520a330dd"
format_stamp: "Formatted at 2026-08-12 01:18:05 on dist-test-slave-rwrg"
server_key: "43e3a5bb880365364ffe474e67b1769d"
server_key_iv: "efda8848564ed60d429ac79333059aef"
server_key_version: "encryptionkey@0"
I20260812 01:18:05.879644 20330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:05.894730 20330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:05.896641 20330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:05.896814 20330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:05.897055 20330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:05.897478 20330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:05.897517 20330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:05.897539 20330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:05.897583 20330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:05.903932 20330 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:41425
I20260812 01:18:05.904013 20575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:41425 every 8 connection(s)
I20260812 01:18:05.904336 20330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
Aug 12 01:18:05 dist-test-slave-rwrg krb5kdc[19645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:05.912709 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 20330
I20260812 01:18:05.912837 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:18:05.913048 18142 external_mini_cluster.cc:1428] Setting key 69c98f91a2294f1c65d46d644d9b5cb7
I20260812 01:18:05.914238 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.905103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:58823 (local address 127.17.183.190:36791)
0812 01:18:05.905174 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:05.905176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:05.905400 (+ 224us) server_negotiation.cc:407] Connection header received
0812 01:18:05.905960 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:05.905962 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:05.905975 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:05.906027 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:05.907026 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.907627 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.908712 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.908929 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.909010 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.911246 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:05.911248 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:05.911248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:05.911255 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:05.912488 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:05.913023 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:05.913025 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:05.913025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:05.913094 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:05.913464 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:05.913466 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:05.913466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:05.913624 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:05.913723 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:05.914069 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 01:18:05.914157 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 01:18:05.914505 20583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.905101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:36791 (local address 127.17.183.131:58823)
0812 01:18:05.905277 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:05.905315 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:05.905840 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:05.906108 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:05.906111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:05.906702 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:05.906909 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.906915 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.907755 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.907756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.908623 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.908625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.909020 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.909021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.909149 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.909693 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:05.909701 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:05.911149 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:05.912635 (+ 1486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:05.912642 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:05.912644 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:05.912938 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:05.913195 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:05.913196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:05.913197 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:05.913378 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:05.913703 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:05.913710 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:05.913910 (+ 200us) client_negotiation.cc:769] Sending connection context
0812 01:18:05.914035 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 01:18:05.914247 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":85,"threads_started":1}
I20260812 01:18:05.914960 20576 heartbeater.cc:347] Connected to a master server at 127.17.183.190:36791
I20260812 01:18:05.915078 20576 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:05.915277 20576 heartbeater.cc:511] Master 127.17.183.190:36791 requested a full tablet report, sending...
I20260812 01:18:05.915674 19739 ts_manager.cc:194] Registered new tserver with Master: 3e034e10339f4a45ad4b17e520a330dd (127.17.183.131:41425)
I20260812 01:18:05.916069 19739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:58823
I20260812 01:18:05.925022 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:18:05.932749 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.926387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35216 (local address 127.17.183.190:36791)
0812 01:18:05.926475 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:05.926478 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:05.926575 (+ 97us) server_negotiation.cc:407] Connection header received
0812 01:18:05.926679 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:05.926680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:05.926690 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:05.926735 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:05.927321 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.927810 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.928619 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.928832 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.928912 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.930225 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:05.930227 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:05.930227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:05.930243 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:05.931397 (+ 1154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:05.931839 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:05.931840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:05.931841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:05.931903 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:05.932133 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:05.932134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:05.932134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:05.932295 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:05.932416 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:05.932569 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 01:18:05.932635 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:18:05.934239 19739 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35216:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:18:05.935847 19739 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:18:05.942698 20604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.938712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57852 (local address 127.17.183.130:42307)
0812 01:18:05.938911 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:05.938916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:05.938929 (+ 13us) server_negotiation.cc:407] Connection header received
0812 01:18:05.939196 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:05.939199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:05.939218 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:05.939291 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:05.939410 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.940114 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.941732 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.942215 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.942320 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.942382 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:05.942554 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 01:18:05.942600 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":97,"threads_started":1}
I20260812 01:18:05.942718 20596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.938278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:41181 (local address 127.0.0.1:46182)
0812 01:18:05.938453 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:05.938494 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:05.938560 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:05.939235 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:05.939236 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:05.939238 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:05.939290 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.939292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.940580 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.940581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.941491 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.941493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.942428 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.942429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.942497 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.942500 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:18:05.942555 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 01:18:05.942590 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":75,"threads_started":1}
I20260812 01:18:05.942795 20603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.938490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46182 (local address 127.17.183.129:41181)
0812 01:18:05.939054 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:05.939059 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:05.939069 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:18:05.939105 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:05.939107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:05.939122 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:05.939367 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:05.939441 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.940479 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.941578 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.942309 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.942429 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.942488 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:05.942653 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 01:18:05.942702 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":97,"threads_started":1}
I20260812 01:18:05.942792 20597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.938278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:41425 (local address 127.0.0.1:50696)
0812 01:18:05.938669 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:05.938680 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:05.938769 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:05.939002 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:05.939006 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:05.939009 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:05.939082 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.939084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.940478 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.940479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.941605 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.941608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.942440 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.942441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.942507 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.942512 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:18:05.942546 (+ 34us) client_negotiation.cc:240] Negotiation successful
0812 01:18:05.942588 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":3,"thread_start_us":62,"threads_started":1}
I20260812 01:18:05.943130 20602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.938486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:42307 (local address 127.0.0.1:57852)
0812 01:18:05.938871 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:05.938880 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:05.938920 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:05.939300 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:05.939301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:05.939304 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:05.939353 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.939355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.940224 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.940225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.941643 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:05.941644 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.942317 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.942318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:05.942399 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.942413 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 01:18:05.942483 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 01:18:05.942553 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"mutex_wait_us":2,"thread_start_us":70,"threads_started":1}
I20260812 01:18:05.943296 20599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:05.938382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50696 (local address 127.17.183.131:41425)
0812 01:18:05.938600 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:05.938605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:05.938770 (+ 165us) server_negotiation.cc:407] Connection header received
0812 01:18:05.938844 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:05.938847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:05.938866 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:05.938982 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:05.939207 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.940373 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.941695 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:05.942345 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:05.942755 (+ 410us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:05.943095 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:05.943123 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 01:18:05.943194 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":91,"threads_started":1}
I20260812 01:18:05.943766 19957 tablet_service.cc:1467] Processing CreateTablet for tablet fa683d5e76c744f69436e79ab1325dfb (DEFAULT_TABLE table=test-table [id=e836a2f7370f4c1eb16923ff982f0fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:05.943895 20453 tablet_service.cc:1467] Processing CreateTablet for tablet fa683d5e76c744f69436e79ab1325dfb (DEFAULT_TABLE table=test-table [id=e836a2f7370f4c1eb16923ff982f0fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:05.944154 19957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa683d5e76c744f69436e79ab1325dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:05.944275 20453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa683d5e76c744f69436e79ab1325dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:05.947122 20605 tablet_bootstrap.cc:492] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a: Bootstrap starting.
I20260812 01:18:05.947726 20200 tablet_service.cc:1467] Processing CreateTablet for tablet fa683d5e76c744f69436e79ab1325dfb (DEFAULT_TABLE table=test-table [id=e836a2f7370f4c1eb16923ff982f0fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:05.947917 20605 tablet_bootstrap.cc:654] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:05.948086 20200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa683d5e76c744f69436e79ab1325dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:05.948572 20605 log.cc:824] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:05.948717 20607 tablet_bootstrap.cc:492] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: Bootstrap starting.
I20260812 01:18:05.949307 20607 tablet_bootstrap.cc:654] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:05.949903 20607 log.cc:824] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:05.950629 20607 tablet_bootstrap.cc:492] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: No bootstrap required, opened a new log
I20260812 01:18:05.950712 20607 ts_tablet_manager.cc:1397] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:18:05.951267 20611 tablet_bootstrap.cc:492] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: Bootstrap starting.
I20260812 01:18:05.951829 20605 tablet_bootstrap.cc:492] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a: No bootstrap required, opened a new log
I20260812 01:18:05.951889 20605 ts_tablet_manager.cc:1397] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260812 01:18:05.952121 20611 tablet_bootstrap.cc:654] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:05.952795 20611 log.cc:824] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:05.952904 20607 raft_consensus.cc:348] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 41181 } } peers { permanent_uuid: "a8f66f22a881492088aa05a0d16dc297" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42307 } } peers { permanent_uuid: "3e034e10339f4a45ad4b17e520a330dd" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 41425 } }
I20260812 01:18:05.953095 20607 raft_consensus.cc:374] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:05.953141 20607 raft_consensus.cc:729] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e034e10339f4a45ad4b17e520a330dd, State: Initialized, Role: FOLLOWER
I20260812 01:18:05.953269 20607 consensus_queue.cc:260] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 41181 } } peers { permanent_uuid: "a8f66f22a881492088aa05a0d16dc297" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42307 } } peers { permanent_uuid: "3e034e10339f4a45ad4b17e520a330dd" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 41425 } }
I20260812 01:18:05.953572 20607 ts_tablet_manager.cc:1428] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:18:05.953524 20605 raft_consensus.cc:348] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 41181 } } peers { permanent_uuid: "a8f66f22a881492088aa05a0d16dc297" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42307 } } peers { permanent_uuid: "3e034e10339f4a45ad4b17e520a330dd" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 41425 } }
I20260812 01:18:05.953683 20611 tablet_bootstrap.cc:492] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: No bootstrap required, opened a new log
I20260812 01:18:05.953699 20576 heartbeater.cc:503] Master 127.17.183.190:36791 was elected leader, sending a full tablet report...
I20260812 01:18:05.953701 20605 raft_consensus.cc:374] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:05.953752 20605 raft_consensus.cc:729] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a873aa82ec234f9ba662d2ed4dc5a59a, State: Initialized, Role: FOLLOWER
I20260812 01:18:05.953761 20611 ts_tablet_manager.cc:1397] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 01:18:05.953869 20605 consensus_queue.cc:260] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 41181 } } peers { permanent_uuid: "a8f66f22a881492088aa05a0d16dc297" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42307 } } peers { permanent_uuid: "3e034e10339f4a45ad4b17e520a330dd" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 41425 } }
I20260812 01:18:05.954186 20605 ts_tablet_manager.cc:1428] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260812 01:18:05.954298 20071 heartbeater.cc:503] Master 127.17.183.190:36791 was elected leader, sending a full tablet report...
I20260812 01:18:05.955670 20611 raft_consensus.cc:348] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 41181 } } peers { permanent_uuid: "a8f66f22a881492088aa05a0d16dc297" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42307 } } peers { permanent_uuid: "3e034e10339f4a45ad4b17e520a330dd" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 41425 } }
I20260812 01:18:05.955808 20611 raft_consensus.cc:374] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:05.955830 20611 raft_consensus.cc:729] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8f66f22a881492088aa05a0d16dc297, State: Initialized, Role: FOLLOWER
I20260812 01:18:05.955955 20611 consensus_queue.cc:260] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 41181 } } peers { permanent_uuid: "a8f66f22a881492088aa05a0d16dc297" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42307 } } peers { permanent_uuid: "3e034e10339f4a45ad4b17e520a330dd" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 41425 } }
I20260812 01:18:05.956233 20611 ts_tablet_manager.cc:1428] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 01:18:05.956265 20324 heartbeater.cc:503] Master 127.17.183.190:36791 was elected leader, sending a full tablet report...
W20260812 01:18:06.000010 20325 tablet.cc:2369] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:18:06.063632 20073 tablet.cc:2369] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:18:06.155014 20580 tablet.cc:2369] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:18:06.268344 20616 raft_consensus.cc:482] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:18:06.268501 20616 raft_consensus.cc:504] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 41181 } } peers { permanent_uuid: "a8f66f22a881492088aa05a0d16dc297" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42307 } } peers { permanent_uuid: "3e034e10339f4a45ad4b17e520a330dd" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 41425 } }
I20260812 01:18:06.268944 20616 leader_election.cc:288] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a873aa82ec234f9ba662d2ed4dc5a59a (127.17.183.129:41181), a8f66f22a881492088aa05a0d16dc297 (127.17.183.130:42307)
I20260812 01:18:06.271878 20583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.269124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:41181 (local address 127.17.183.131:56259)
0812 01:18:06.269193 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:06.269208 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:06.269300 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:06.269540 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:06.269542 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:06.269544 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:06.269624 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:06.269626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.270281 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.270282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:06.271036 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:06.271038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.271589 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.271591 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:06.271673 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:06.271676 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:18:06.271761 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 01:18:06.271802 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 01:18:06.271878 20603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.269259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:56259 (local address 127.17.183.129:41181)
0812 01:18:06.269412 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:06.269413 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:06.269421 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:18:06.269457 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:06.269458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:06.269466 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:06.269533 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:06.269701 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.270185 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.271146 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.271505 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.271589 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:06.271599 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:06.271770 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 01:18:06.271805 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260812 01:18:06.272008 20604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.269355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:49277 (local address 127.17.183.130:42307)
0812 01:18:06.269431 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:06.269433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:06.269545 (+ 112us) server_negotiation.cc:407] Connection header received
0812 01:18:06.269629 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:06.269630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:06.269639 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:06.269714 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:06.269883 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.270345 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.271287 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.271643 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.271736 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:06.271744 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:06.271908 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 01:18:06.271944 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 01:18:06.272019 20628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.269255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:42307 (local address 127.17.183.131:49277)
0812 01:18:06.269474 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:06.269490 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:06.269563 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:06.269718 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:06.269719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:06.269721 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:06.269805 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:06.269807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.270428 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.270429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:06.271192 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:06.271193 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.271740 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.271741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:06.271820 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:06.271824 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:06.271899 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 01:18:06.271938 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":142,"threads_started":1}
I20260812 01:18:06.272265 19991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa683d5e76c744f69436e79ab1325dfb" candidate_uuid: "3e034e10339f4a45ad4b17e520a330dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" is_pre_election: true
I20260812 01:18:06.272348 20241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa683d5e76c744f69436e79ab1325dfb" candidate_uuid: "3e034e10339f4a45ad4b17e520a330dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8f66f22a881492088aa05a0d16dc297" is_pre_election: true
I20260812 01:18:06.272444 19991 raft_consensus.cc:2454] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e034e10339f4a45ad4b17e520a330dd in term 0.
I20260812 01:18:06.272470 20241 raft_consensus.cc:2454] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e034e10339f4a45ad4b17e520a330dd in term 0.
I20260812 01:18:06.272701 20357 leader_election.cc:302] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e034e10339f4a45ad4b17e520a330dd, a873aa82ec234f9ba662d2ed4dc5a59a; no voters:
I20260812 01:18:06.272830 20616 raft_consensus.cc:2781] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:18:06.272889 20616 raft_consensus.cc:482] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:18:06.272913 20616 raft_consensus.cc:3037] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:06.273607 20616 raft_consensus.cc:504] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 41181 } } peers { permanent_uuid: "a8f66f22a881492088aa05a0d16dc297" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42307 } } peers { permanent_uuid: "3e034e10339f4a45ad4b17e520a330dd" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 41425 } }
I20260812 01:18:06.273732 20616 leader_election.cc:288] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [CANDIDATE]: Term 1 election: Requested vote from peers a873aa82ec234f9ba662d2ed4dc5a59a (127.17.183.129:41181), a8f66f22a881492088aa05a0d16dc297 (127.17.183.130:42307)
I20260812 01:18:06.273874 19991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa683d5e76c744f69436e79ab1325dfb" candidate_uuid: "3e034e10339f4a45ad4b17e520a330dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a"
I20260812 01:18:06.273904 20241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa683d5e76c744f69436e79ab1325dfb" candidate_uuid: "3e034e10339f4a45ad4b17e520a330dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8f66f22a881492088aa05a0d16dc297"
I20260812 01:18:06.273952 19991 raft_consensus.cc:3037] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:06.274000 20241 raft_consensus.cc:3037] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:06.274655 19991 raft_consensus.cc:2454] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e034e10339f4a45ad4b17e520a330dd in term 1.
I20260812 01:18:06.274842 20357 leader_election.cc:302] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e034e10339f4a45ad4b17e520a330dd, a873aa82ec234f9ba662d2ed4dc5a59a; no voters:
I20260812 01:18:06.274860 20241 raft_consensus.cc:2454] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e034e10339f4a45ad4b17e520a330dd in term 1.
I20260812 01:18:06.274959 20616 raft_consensus.cc:2781] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:06.275135 20616 raft_consensus.cc:686] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 1 LEADER]: Becoming Leader. State: Replica: 3e034e10339f4a45ad4b17e520a330dd, State: Running, Role: LEADER
I20260812 01:18:06.275244 20616 consensus_queue.cc:237] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 41181 } } peers { permanent_uuid: "a8f66f22a881492088aa05a0d16dc297" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42307 } } peers { permanent_uuid: "3e034e10339f4a45ad4b17e520a330dd" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 41425 } }
I20260812 01:18:06.276144 19739 catalog_manager.cc:5495] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e034e10339f4a45ad4b17e520a330dd (127.17.183.131). New cstate: current_term: 1 leader_uuid: "3e034e10339f4a45ad4b17e520a330dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 41181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8f66f22a881492088aa05a0d16dc297" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e034e10339f4a45ad4b17e520a330dd" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 41425 } health_report { overall_health: HEALTHY } } }
I20260812 01:18:06.295909 20599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.293642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50710 (local address 127.17.183.131:41425)
0812 01:18:06.293685 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:06.293687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:06.293696 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:18:06.293735 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:06.293736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:06.293755 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:06.293842 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:06.293944 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.294389 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.295151 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.295360 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.295435 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:06.295569 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:06.295678 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:06.295785 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:06.295817 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 01:18:06.295828 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 01:18:06.297919 20241 raft_consensus.cc:1261] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297 [term 1 FOLLOWER]: Refusing update from remote peer 3e034e10339f4a45ad4b17e520a330dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:06.297932 19991 raft_consensus.cc:1261] T fa683d5e76c744f69436e79ab1325dfb P a873aa82ec234f9ba662d2ed4dc5a59a [term 1 FOLLOWER]: Refusing update from remote peer 3e034e10339f4a45ad4b17e520a330dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:06.298277 20616 consensus_queue.cc:1035] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873aa82ec234f9ba662d2ed4dc5a59a" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 41181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:06.298414 20629 consensus_queue.cc:1035] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8f66f22a881492088aa05a0d16dc297" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 42307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:06.300714 20633 mvcc.cc:205] Tried to move back new op lower bound from 7317493703873040384 to 7317493703784062976. Current Snapshot: MvccSnapshot[applied={T|T < 7317493703873040384}]
I20260812 01:18:06.301083 20637 mvcc.cc:205] Tried to move back new op lower bound from 7317493703873040384 to 7317493703784062976. Current Snapshot: MvccSnapshot[applied={T|T < 7317493703873040384}]
I20260812 01:18:06.303261 19738 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:06.303354 19738 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:06.304106 19738 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63a7112f3a9f42b3a04cfaee9ad8e4e4: Sending DeleteTablet for 3 replicas of tablet fa683d5e76c744f69436e79ab1325dfb
I20260812 01:18:06.304447 20453 tablet_service.cc:1514] Processing DeleteTablet for tablet fa683d5e76c744f69436e79ab1325dfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:06 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:50696
I20260812 01:18:06.304688 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 19832
I20260812 01:18:06.304689 19957 tablet_service.cc:1514] Processing DeleteTablet for tablet fa683d5e76c744f69436e79ab1325dfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:06 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:46182
I20260812 01:18:06.304701 20652 tablet_replica.cc:330] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: stopping tablet replica
I20260812 01:18:06.304940 20652 raft_consensus.cc:2229] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:18:06.305085 20652 raft_consensus.cc:2258] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:06.314520 20200 tablet_service.cc:1514] Processing DeleteTablet for tablet fa683d5e76c744f69436e79ab1325dfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:06 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:57852
I20260812 01:18:06.314785 20653 tablet_replica.cc:330] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: stopping tablet replica
I20260812 01:18:06.314914 20653 raft_consensus.cc:2229] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:18:06.315065 20653 raft_consensus.cc:2258] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:06.315513 20653 ts_tablet_manager.cc:1905] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:06.316926 20652 ts_tablet_manager.cc:1905] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:06.317034 20653 ts_tablet_manager.cc:1918] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:06.317116 20653 log.cc:1196] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/fa683d5e76c744f69436e79ab1325dfb
I20260812 01:18:06.317389 20653 ts_tablet_manager.cc:1939] T fa683d5e76c744f69436e79ab1325dfb P a8f66f22a881492088aa05a0d16dc297: Deleting consensus metadata
I20260812 01:18:06.317821 19706 catalog_manager.cc:4841] TS a8f66f22a881492088aa05a0d16dc297 (127.17.183.130:42307): tablet fa683d5e76c744f69436e79ab1325dfb (table test-table [id=e836a2f7370f4c1eb16923ff982f0fe8]) successfully deleted
I20260812 01:18:06.318920 20652 ts_tablet_manager.cc:1918] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:06.319012 20652 log.cc:1196] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/fa683d5e76c744f69436e79ab1325dfb
I20260812 01:18:06.319299 20652 ts_tablet_manager.cc:1939] T fa683d5e76c744f69436e79ab1325dfb P 3e034e10339f4a45ad4b17e520a330dd: Deleting consensus metadata
I20260812 01:18:06.319725 19704 catalog_manager.cc:4841] TS 3e034e10339f4a45ad4b17e520a330dd (127.17.183.131:41425): tablet fa683d5e76c744f69436e79ab1325dfb (table test-table [id=e836a2f7370f4c1eb16923ff982f0fe8]) successfully deleted
W20260812 01:18:06.320411 19706 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:41181 (error 108)
I20260812 01:18:06.320948 20602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.320818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:41181 (local address 127.0.0.1:46194)
0812 01:18:06.320874 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:06.320910 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:41181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 01:18:06.321053 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 20083
W20260812 01:18:06.339697 19706 catalog_manager.cc:4584] TS a873aa82ec234f9ba662d2ed4dc5a59a (127.17.183.129:41181): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fa683d5e76c744f69436e79ab1325dfb: Network error: Client connection negotiation failed: client connection to 127.17.183.129:41181: connect: Connection refused (error 111)
I20260812 01:18:06.349031 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 20330
I20260812 01:18:06.363535 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 19672
2026-08-12T01:18:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2558 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T01:18:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:06Z Disabled control of system clock
I20260812 01:18:06.398722 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:34871
--webserver_interface=127.17.183.190
--webserver_port=0
--builtin_ntp_servers=127.17.183.148:35983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:34871
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:18:06.481746 20661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:06.481971 20661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:06.481993 20661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:06.483075 20661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:06.483114 20661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:06.483126 20661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:06.483139 20661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:06.483151 20661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:06.484428 20661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:34871
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:34871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:06.484647 20661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:06.484890 20661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:06.489923 20669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:06.489933 20674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:06.489961 20670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:06.490010 20661 server_base.cc:1034] running on GCE node
I20260812 01:18:06.490442 20661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:06.490743 20661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:06.491896 20661 hybrid_clock.cc:648] HybridClock initialized: now 1786497486491875 us; error 38 us; skew 500 ppm
I20260812 01:18:06.493203 20661 webserver.cc:460] Webserver started at http://127.17.183.190:33931/ using document root <none> and password file <none>
I20260812 01:18:06.493449 20661 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:06.493496 20661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:06.493680 20661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:06.494800 20661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "af4c02e1c06748208a5ea1a05ff5f795"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "272a6c8c8f7ed2e17696a942e9ca3bba"
server_key_iv: "0926a31c67a6cfe545709706396fef1c"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.495165 20661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "af4c02e1c06748208a5ea1a05ff5f795"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "272a6c8c8f7ed2e17696a942e9ca3bba"
server_key_iv: "0926a31c67a6cfe545709706396fef1c"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.496475 20661 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:06.497287 20688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:06.497463 20661 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:18:06.497565 20661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "af4c02e1c06748208a5ea1a05ff5f795"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "272a6c8c8f7ed2e17696a942e9ca3bba"
server_key_iv: "0926a31c67a6cfe545709706396fef1c"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.497653 20661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:06.511806 20661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:06.512116 20661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:06.512277 20661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:06.516269 20661 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:34871
I20260812 01:18:06.516302 20773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:34871 every 8 connection(s)
I20260812 01:18:06.516731 20661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:06.517745 20774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:06.519999 20774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795: Bootstrap starting.
I20260812 01:18:06.520573 20774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:06.520838 20774 log.cc:824] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:06.521502 20774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795: No bootstrap required, opened a new log
I20260812 01:18:06.523063 20774 raft_consensus.cc:348] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4c02e1c06748208a5ea1a05ff5f795" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34871 } }
I20260812 01:18:06.523207 20774 raft_consensus.cc:374] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:06.523258 20774 raft_consensus.cc:729] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af4c02e1c06748208a5ea1a05ff5f795, State: Initialized, Role: FOLLOWER
I20260812 01:18:06.523434 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 20661
I20260812 01:18:06.523418 20774 consensus_queue.cc:260] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4c02e1c06748208a5ea1a05ff5f795" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34871 } }
I20260812 01:18:06.523497 20774 raft_consensus.cc:388] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:06.523535 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:06.523545 20774 raft_consensus.cc:482] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:06.523590 20774 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:06.523767 18142 external_mini_cluster.cc:1428] Setting key 0d0046a6a554f8cb5cbc8368c3e01190
I20260812 01:18:06.524255 20774 raft_consensus.cc:504] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4c02e1c06748208a5ea1a05ff5f795" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34871 } }
I20260812 01:18:06.524369 20774 leader_election.cc:302] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af4c02e1c06748208a5ea1a05ff5f795; no voters:
I20260812 01:18:06.524573 20774 leader_election.cc:288] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:06.524607 20783 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:06.524799 20783 raft_consensus.cc:686] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [term 1 LEADER]: Becoming Leader. State: Replica: af4c02e1c06748208a5ea1a05ff5f795, State: Running, Role: LEADER
I20260812 01:18:06.524835 20774 sys_catalog.cc:564] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:06.524911 20783 consensus_queue.cc:237] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4c02e1c06748208a5ea1a05ff5f795" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34871 } }
I20260812 01:18:06.525213 20783 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af4c02e1c06748208a5ea1a05ff5f795. Latest consensus state: current_term: 1 leader_uuid: "af4c02e1c06748208a5ea1a05ff5f795" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4c02e1c06748208a5ea1a05ff5f795" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34871 } } }
I20260812 01:18:06.525312 20783 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:06.525413 20789 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af4c02e1c06748208a5ea1a05ff5f795" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4c02e1c06748208a5ea1a05ff5f795" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34871 } } }
I20260812 01:18:06.525542 20789 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:06.525579 20795 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:06.526211 20795 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:06.527961 20795 catalog_manager.cc:1347] Generated new cluster ID: 1a860115a90f46ceac682256e181244e
I20260812 01:18:06.528147 20795 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:06.530601 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.524269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42700 (local address 127.17.183.190:34871)
0812 01:18:06.524587 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:06.524596 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:06.524630 (+ 34us) server_negotiation.cc:407] Connection header received
0812 01:18:06.524746 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:06.524752 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:06.524835 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:06.525272 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:06.525377 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.527118 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.528260 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.528871 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.528998 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:06.529733 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:06.529745 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:06.529745 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:06.529967 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:06.530011 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:06.530028 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:06.530101 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:06.530166 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 01:18:06.530350 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":93,"threads_started":1}
I20260812 01:18:06.549835 20795 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:06.550549 20795 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:06.556125 20795 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795: Generated new TSK 0
I20260812 01:18:06.556291 20795 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:06.562732 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34871
--builtin_ntp_servers=127.17.183.148:35983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:18:06.653365 20819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:06.653594 20819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:06.653630 20819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:06.654742 20819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:06.654834 20819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:06.654881 20819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:18:06.656258 20819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:06.656571 20819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:06.656915 20819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:06.661901 20825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:06.661912 20828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:06.662117 20831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:06.662402 20819 server_base.cc:1034] running on GCE node
I20260812 01:18:06.662596 20819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:06.662827 20819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:06.663976 20819 hybrid_clock.cc:648] HybridClock initialized: now 1786497486663961 us; error 29 us; skew 500 ppm
I20260812 01:18:06.665359 20819 webserver.cc:460] Webserver started at http://127.17.183.129:35013/ using document root <none> and password file <none>
I20260812 01:18:06.665616 20819 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:06.665668 20819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:06.665845 20819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:06.666944 20819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "c0e40697aec547df8452e2db15489c65"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "a926c12376d5a9af3f627df96b59a6a0"
server_key_iv: "8dc1dcac6cff6e618e4b820c4e6ee552"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.667316 20819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "c0e40697aec547df8452e2db15489c65"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "a926c12376d5a9af3f627df96b59a6a0"
server_key_iv: "8dc1dcac6cff6e618e4b820c4e6ee552"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.668732 20819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:18:06.669483 20843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:06.669665 20819 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:06.669761 20819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "c0e40697aec547df8452e2db15489c65"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "a926c12376d5a9af3f627df96b59a6a0"
server_key_iv: "8dc1dcac6cff6e618e4b820c4e6ee552"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.669839 20819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:06.696942 20819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:06.697301 20819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:06.697463 20819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:06.697721 20819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:06.698097 20819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:06.698161 20819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:06.698206 20819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:06.698244 20819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:06.704681 20819 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:46751
I20260812 01:18:06.704792 21037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:46751 every 8 connection(s)
I20260812 01:18:06.705137 20819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:18:06.709550 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 20819
I20260812 01:18:06.709673 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:18:06.709926 18142 external_mini_cluster.cc:1428] Setting key 830ceb095cff8385154857d341738c8a
I20260812 01:18:06.710760 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.705970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:40767 (local address 127.17.183.190:34871)
0812 01:18:06.706066 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:06.706069 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:06.706301 (+ 232us) server_negotiation.cc:407] Connection header received
0812 01:18:06.706772 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:06.706773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:06.706783 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:06.706836 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:06.707471 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.707953 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.709087 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.709295 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.709354 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:06.710424 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:06.710426 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:06.710426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:06.710430 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:06.710444 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:06.710448 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:06.710491 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:06.710654 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 01:18:06.710682 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 01:18:06.711020 21042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.705936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:34871 (local address 127.17.183.129:40767)
0812 01:18:06.706156 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:06.706190 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:06.706684 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:06.706885 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:06.706889 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:06.706897 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:06.707397 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:06.707401 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.708035 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.708036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:06.708996 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:06.709000 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.709416 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.709417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:06.709611 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:06.710262 (+ 651us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:18:06.710263 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:06.710312 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:18:06.710341 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:06.710509 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:06.710514 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:06.710517 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:18:06.710642 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 01:18:06.710748 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":112,"threads_started":1}
I20260812 01:18:06.711076 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34871
--builtin_ntp_servers=127.17.183.148:35983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 01:18:06.711479 21038 heartbeater.cc:347] Connected to a master server at 127.17.183.190:34871
I20260812 01:18:06.711563 21038 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:06.711777 21038 heartbeater.cc:511] Master 127.17.183.190:34871 requested a full tablet report, sending...
I20260812 01:18:06.712273 20719 ts_manager.cc:194] Registered new tserver with Master: c0e40697aec547df8452e2db15489c65 (127.17.183.129:46751)
I20260812 01:18:06.712968 20719 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.129:40767
W20260812 01:18:06.796057 21045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:06.796259 21045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:06.796280 21045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:06.797348 21045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:06.797382 21045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:06.797406 21045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:18:06.798636 21045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:06.798828 21045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:06.799074 21045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 01:18:06.804404 21045 server_base.cc:1034] running on GCE node
W20260812 01:18:06.804431 21053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:06.804402 21062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:06.804564 21054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:06.804850 21045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:06.805094 21045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:06.806269 21045 hybrid_clock.cc:648] HybridClock initialized: now 1786497486806262 us; error 43 us; skew 500 ppm
I20260812 01:18:06.807487 21045 webserver.cc:460] Webserver started at http://127.17.183.130:35727/ using document root <none> and password file <none>
I20260812 01:18:06.807766 21045 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:06.807834 21045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:06.808012 21045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:06.809195 21045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "5bda80d14cec92f45c48262319a7952e"
server_key_iv: "8e3b3b797396af9ca56d21658f8ad179"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.809571 21045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "5bda80d14cec92f45c48262319a7952e"
server_key_iv: "8e3b3b797396af9ca56d21658f8ad179"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.810962 21045 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 01:18:06.811760 21071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:06.811942 21045 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:18:06.812032 21045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "5bda80d14cec92f45c48262319a7952e"
server_key_iv: "8e3b3b797396af9ca56d21658f8ad179"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.812119 21045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:06.840209 21045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:06.840610 21045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:06.840771 21045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:06.841027 21045 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:06.841390 21045 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:06.841444 21045 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:06.841478 21045 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:06.841504 21045 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:06.847465 21045 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:38551
I20260812 01:18:06.847522 21292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:38551 every 8 connection(s)
I20260812 01:18:06.847852 21045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:18:06.853108 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.848628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:33639 (local address 127.17.183.190:34871)
0812 01:18:06.848679 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:06.848682 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:06.848923 (+ 241us) server_negotiation.cc:407] Connection header received
0812 01:18:06.849488 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:06.849489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:06.849506 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:06.849559 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:06.850258 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.850770 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.851727 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.851942 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.852021 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:06.852811 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:06.852812 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:06.852813 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:06.852818 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:06.852830 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:06.852834 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:06.852901 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:06.852996 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 01:18:06.853026 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 01:18:06.853363 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.848603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:34871 (local address 127.17.183.130:33639)
0812 01:18:06.848797 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:06.848833 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:06.849374 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:06.849642 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:06.849646 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:06.849662 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:06.850161 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:06.850165 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.850874 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.850875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:06.851636 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:06.851638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:06.852033 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:06.852034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:06.852171 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:06.852672 (+ 501us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:18:06.852673 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:06.852701 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:18:06.852723 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:06.852902 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:06.852909 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:06.852913 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:06.852998 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 01:18:06.853114 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
I20260812 01:18:06.853816 21293 heartbeater.cc:347] Connected to a master server at 127.17.183.190:34871
I20260812 01:18:06.853926 21293 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:06.854117 21293 heartbeater.cc:511] Master 127.17.183.190:34871 requested a full tablet report, sending...
I20260812 01:18:06.854513 20719 ts_manager.cc:194] Registered new tserver with Master: 8e0c00fe0ac145b689dd2c6cc34d0d66 (127.17.183.130:38551)
I20260812 01:18:06.854861 20719 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.130:33639
I20260812 01:18:06.857463 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 21045
I20260812 01:18:06.857592 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:18:06.857838 18142 external_mini_cluster.cc:1428] Setting key 71f0aafb66c6b8de76620c09338dbf04
I20260812 01:18:06.858758 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34871
--builtin_ntp_servers=127.17.183.148:35983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:18:06.941756 21300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:06.942004 21300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:06.942039 21300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:06.943207 21300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:06.943276 21300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:06.943317 21300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:18:06.944715 21300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:35983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:34871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:06.944990 21300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:06.945307 21300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:06.950724 21317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:06.950752 21300 server_base.cc:1034] running on GCE node
W20260812 01:18:06.950744 21312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:06.950724 21313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:06.951135 21300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:06.951339 21300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:06.952482 21300 hybrid_clock.cc:648] HybridClock initialized: now 1786497486952470 us; error 30 us; skew 500 ppm
I20260812 01:18:06.953748 21300 webserver.cc:460] Webserver started at http://127.17.183.131:46723/ using document root <none> and password file <none>
I20260812 01:18:06.954002 21300 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:06.954049 21300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:06.954213 21300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:06.955283 21300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "d589d405d7de43f0815753b3694ea4b0"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "71da4b22ec2d7eacdaecf246aeaec5d2"
server_key_iv: "89926985f1f4b8be9577f90e9965d875"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.955646 21300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "d589d405d7de43f0815753b3694ea4b0"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "71da4b22ec2d7eacdaecf246aeaec5d2"
server_key_iv: "89926985f1f4b8be9577f90e9965d875"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.957036 21300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:06.957777 21324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:06.957962 21300 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:18:06.958067 21300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "d589d405d7de43f0815753b3694ea4b0"
format_stamp: "Formatted at 2026-08-12 01:18:06 on dist-test-slave-rwrg"
server_key: "71da4b22ec2d7eacdaecf246aeaec5d2"
server_key_iv: "89926985f1f4b8be9577f90e9965d875"
server_key_version: "encryptionkey@0"
I20260812 01:18:06.958144 21300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:06.991015 21300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:06.991358 21300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:06.991515 21300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:06.991762 21300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:06.992097 21300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:06.992156 21300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:06.992200 21300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:06.992224 21300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:06.998432 21300 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:42147
I20260812 01:18:06.998487 21513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:42147 every 8 connection(s)
I20260812 01:18:06.998843 21300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:18:07.003993 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.999576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:40755 (local address 127.17.183.190:34871)
0812 01:18:06.999656 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:06.999659 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:06.999925 (+ 266us) server_negotiation.cc:407] Connection header received
0812 01:18:07.000451 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:07.000451 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:07.000461 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:07.000573 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:07.001313 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.001837 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.002746 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.002922 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.002973 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.003800 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:07.003801 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:07.003801 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:07.003805 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:07.003815 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:07.003819 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:07.003855 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:07.003916 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 01:18:07.003936 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:18:07.004245 21518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:06.999564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:34871 (local address 127.17.183.131:40755)
0812 01:18:06.999778 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:06.999832 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:07.000361 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:07.000674 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:07.000679 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:07.000690 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:07.001232 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.001237 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.001919 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.001919 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.002675 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.002677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.002997 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.002998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.003109 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.003669 (+ 560us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:18:07.003669 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:07.003699 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:18:07.003722 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:07.003857 (+ 135us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:07.003859 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:07.003861 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:18:07.003906 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 01:18:07.003981 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":110,"threads_started":1}
I20260812 01:18:07.004778 21516 heartbeater.cc:347] Connected to a master server at 127.17.183.190:34871
I20260812 01:18:07.004904 21516 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:07.005055 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 21300
I20260812 01:18:07.005138 21516 heartbeater.cc:511] Master 127.17.183.190:34871 requested a full tablet report, sending...
I20260812 01:18:07.005182 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:18:07.005429 18142 external_mini_cluster.cc:1428] Setting key 5bf06108c6075486f0c6d86c8484eff8
I20260812 01:18:07.005578 20719 ts_manager.cc:194] Registered new tserver with Master: d589d405d7de43f0815753b3694ea4b0 (127.17.183.131:42147)
I20260812 01:18:07.006060 20719 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.131:40755
I20260812 01:18:07.006347 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:18:07.010417 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.007751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42712 (local address 127.17.183.190:34871)
0812 01:18:07.007797 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:07.007798 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:07.007887 (+ 89us) server_negotiation.cc:407] Connection header received
0812 01:18:07.007926 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:07.007926 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:07.007934 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:07.007974 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:07.008114 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.008610 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.009333 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.009500 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.009548 (+ 48us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.010173 (+ 625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:07.010175 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:07.010175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:07.010179 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:07.010190 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:07.010194 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:07.010258 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:07.010302 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 01:18:07.010311 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 01:18:07.012044 20719 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:18:07.013882 20719 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:18:07.020018 21531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.016038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:42147 (local address 127.0.0.1:39368)
0812 01:18:07.016235 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:07.016273 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:07.016340 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:07.016690 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:07.016694 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:07.016696 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:07.016784 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.016786 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.017758 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.017759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.018912 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.018915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.019714 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.019715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.019805 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.019819 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 01:18:07.019896 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 01:18:07.019947 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":75,"threads_started":1}
I20260812 01:18:07.020030 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.016119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39368 (local address 127.17.183.131:42147)
0812 01:18:07.016477 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:07.016482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:07.016491 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:18:07.016555 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:07.016557 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:07.016574 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:07.016667 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:07.016873 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.017658 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.019011 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.019624 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.019713 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.019801 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:07.019910 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 01:18:07.019947 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":81,"threads_started":1}
I20260812 01:18:07.020324 21535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.016276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:46751 (local address 127.0.0.1:46754)
0812 01:18:07.016440 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:07.016450 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:07.016489 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:07.016927 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:07.016928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:07.016930 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:07.016959 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.016961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.018222 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.018223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.019064 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.019067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.020057 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.020059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.020136 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.020139 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:18:07.020194 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 01:18:07.020236 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":98,"threads_started":1}
I20260812 01:18:07.020419 21539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.016044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:38551 (local address 127.0.0.1:58772)
0812 01:18:07.016418 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:07.016430 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:07.016486 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:07.016821 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:07.016822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:07.016824 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:07.016870 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.016872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.018181 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.018182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.019233 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.019236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.020217 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.020218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.020269 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.020271 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:18:07.020316 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 01:18:07.020349 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":72,"threads_started":1}
I20260812 01:18:07.020366 21540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.016388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46754 (local address 127.17.183.129:46751)
0812 01:18:07.016595 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:07.016599 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:07.016610 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:18:07.016654 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:07.016656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:07.016669 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:07.016739 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:07.017046 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.018163 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.019131 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.019859 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.019934 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.020017 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:07.020220 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 01:18:07.020279 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":84,"threads_started":1}
I20260812 01:18:07.020715 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.016139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58772 (local address 127.17.183.130:38551)
0812 01:18:07.016631 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:07.016652 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:07.016662 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:18:07.016701 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:07.016703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:07.016718 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:07.016809 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:07.016960 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.018087 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.019324 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.020037 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.020102 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.020183 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:07.020543 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 01:18:07.020596 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":83,"threads_started":1}
I20260812 01:18:07.021159 21411 tablet_service.cc:1467] Processing CreateTablet for tablet f198b6f849c64cdf807eb3e981bd0145 (DEFAULT_TABLE table=test-table [id=f17ba124734f40999a532e226bf64eb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:07.021371 21169 tablet_service.cc:1467] Processing CreateTablet for tablet f198b6f849c64cdf807eb3e981bd0145 (DEFAULT_TABLE table=test-table [id=f17ba124734f40999a532e226bf64eb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:07.021559 21411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f198b6f849c64cdf807eb3e981bd0145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:07.021739 21169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f198b6f849c64cdf807eb3e981bd0145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:07.024421 21542 tablet_bootstrap.cc:492] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: Bootstrap starting.
I20260812 01:18:07.024430 21541 tablet_bootstrap.cc:492] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: Bootstrap starting.
I20260812 01:18:07.024446 20935 tablet_service.cc:1467] Processing CreateTablet for tablet f198b6f849c64cdf807eb3e981bd0145 (DEFAULT_TABLE table=test-table [id=f17ba124734f40999a532e226bf64eb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:07.024832 20935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f198b6f849c64cdf807eb3e981bd0145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:07.025188 21541 tablet_bootstrap.cc:654] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:07.025223 21542 tablet_bootstrap.cc:654] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:07.025601 21541 log.cc:824] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:07.025650 21542 log.cc:824] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:07.026364 21541 tablet_bootstrap.cc:492] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: No bootstrap required, opened a new log
I20260812 01:18:07.026456 21541 ts_tablet_manager.cc:1397] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 01:18:07.027840 21546 tablet_bootstrap.cc:492] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65: Bootstrap starting.
I20260812 01:18:07.028623 21546 tablet_bootstrap.cc:654] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:07.028877 21542 tablet_bootstrap.cc:492] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: No bootstrap required, opened a new log
I20260812 01:18:07.028957 21542 ts_tablet_manager.cc:1397] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260812 01:18:07.028954 21546 log.cc:824] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:07.029119 21541 raft_consensus.cc:348] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 38551 } } peers { permanent_uuid: "d589d405d7de43f0815753b3694ea4b0" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 42147 } } peers { permanent_uuid: "c0e40697aec547df8452e2db15489c65" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 46751 } }
I20260812 01:18:07.029325 21541 raft_consensus.cc:374] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:07.029372 21541 raft_consensus.cc:729] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d589d405d7de43f0815753b3694ea4b0, State: Initialized, Role: FOLLOWER
I20260812 01:18:07.029510 21541 consensus_queue.cc:260] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 38551 } } peers { permanent_uuid: "d589d405d7de43f0815753b3694ea4b0" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 42147 } } peers { permanent_uuid: "c0e40697aec547df8452e2db15489c65" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 46751 } }
I20260812 01:18:07.029768 21546 tablet_bootstrap.cc:492] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65: No bootstrap required, opened a new log
I20260812 01:18:07.029809 21541 ts_tablet_manager.cc:1428] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260812 01:18:07.029839 21546 ts_tablet_manager.cc:1397] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 01:18:07.029927 21516 heartbeater.cc:503] Master 127.17.183.190:34871 was elected leader, sending a full tablet report...
I20260812 01:18:07.031383 21542 raft_consensus.cc:348] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 38551 } } peers { permanent_uuid: "d589d405d7de43f0815753b3694ea4b0" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 42147 } } peers { permanent_uuid: "c0e40697aec547df8452e2db15489c65" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 46751 } }
I20260812 01:18:07.031528 21542 raft_consensus.cc:374] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:07.031574 21542 raft_consensus.cc:729] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e0c00fe0ac145b689dd2c6cc34d0d66, State: Initialized, Role: FOLLOWER
I20260812 01:18:07.031689 21542 consensus_queue.cc:260] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 38551 } } peers { permanent_uuid: "d589d405d7de43f0815753b3694ea4b0" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 42147 } } peers { permanent_uuid: "c0e40697aec547df8452e2db15489c65" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 46751 } }
I20260812 01:18:07.031957 21542 ts_tablet_manager.cc:1428] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:18:07.031986 21546 raft_consensus.cc:348] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 38551 } } peers { permanent_uuid: "d589d405d7de43f0815753b3694ea4b0" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 42147 } } peers { permanent_uuid: "c0e40697aec547df8452e2db15489c65" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 46751 } }
I20260812 01:18:07.032140 21293 heartbeater.cc:503] Master 127.17.183.190:34871 was elected leader, sending a full tablet report...
I20260812 01:18:07.032140 21546 raft_consensus.cc:374] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:07.032179 21546 raft_consensus.cc:729] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e40697aec547df8452e2db15489c65, State: Initialized, Role: FOLLOWER
I20260812 01:18:07.032299 21546 consensus_queue.cc:260] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 38551 } } peers { permanent_uuid: "d589d405d7de43f0815753b3694ea4b0" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 42147 } } peers { permanent_uuid: "c0e40697aec547df8452e2db15489c65" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 46751 } }
I20260812 01:18:07.032572 21546 ts_tablet_manager.cc:1428] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:18:07.032622 21038 heartbeater.cc:503] Master 127.17.183.190:34871 was elected leader, sending a full tablet report...
W20260812 01:18:07.098399 21294 tablet.cc:2369] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:18:07.205896 21041 tablet.cc:2369] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:18:07.249403 21517 tablet.cc:2369] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:18:07.378823 21550 raft_consensus.cc:482] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:18:07.379021 21550 raft_consensus.cc:504] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 38551 } } peers { permanent_uuid: "d589d405d7de43f0815753b3694ea4b0" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 42147 } } peers { permanent_uuid: "c0e40697aec547df8452e2db15489c65" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 46751 } }
I20260812 01:18:07.379467 21550 leader_election.cc:288] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d589d405d7de43f0815753b3694ea4b0 (127.17.183.131:42147), c0e40697aec547df8452e2db15489c65 (127.17.183.129:46751)
I20260812 01:18:07.382512 21540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.379742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:33323 (local address 127.17.183.129:46751)
0812 01:18:07.379785 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:07.379787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:07.379921 (+ 134us) server_negotiation.cc:407] Connection header received
0812 01:18:07.379959 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:07.379960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:07.379974 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:07.380025 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:07.380233 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.380781 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.381812 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.382158 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.382214 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.382221 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:07.382400 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 01:18:07.382445 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:18:07.382516 21556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.379669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:46751 (local address 127.17.183.130:33323)
0812 01:18:07.379820 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:07.379831 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:07.379893 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:07.380052 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:07.380053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:07.380056 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:07.380153 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.380155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.380861 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.380862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.381682 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.381684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.382243 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.382244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.382314 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.382318 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:07.382372 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 01:18:07.382402 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":89,"threads_started":1}
I20260812 01:18:07.382603 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.379738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:34123 (local address 127.17.183.131:42147)
0812 01:18:07.379784 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:07.379786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:07.379947 (+ 161us) server_negotiation.cc:407] Connection header received
0812 01:18:07.379993 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:07.379993 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:07.380001 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:07.380076 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:07.380272 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.380879 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.381844 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.382207 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.382278 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.382286 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:07.382473 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 01:18:07.382512 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:18:07.382658 21554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.379673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:42147 (local address 127.17.183.130:34123)
0812 01:18:07.379844 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:07.379854 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:07.379935 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:07.380100 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:07.380101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:07.380103 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:07.380176 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.380177 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.380968 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.380969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.381693 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:07.381695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.382309 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.382310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:07.382384 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.382390 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 01:18:07.382449 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 01:18:07.382484 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":82,"threads_started":1}
I20260812 01:18:07.382933 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f198b6f849c64cdf807eb3e981bd0145" candidate_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e40697aec547df8452e2db15489c65" is_pre_election: true
I20260812 01:18:07.383103 20970 raft_consensus.cc:2454] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e0c00fe0ac145b689dd2c6cc34d0d66 in term 0.
I20260812 01:18:07.383152 21444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f198b6f849c64cdf807eb3e981bd0145" candidate_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d589d405d7de43f0815753b3694ea4b0" is_pre_election: true
I20260812 01:18:07.383332 21444 raft_consensus.cc:2454] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e0c00fe0ac145b689dd2c6cc34d0d66 in term 0.
I20260812 01:18:07.383373 21078 leader_election.cc:302] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e0c00fe0ac145b689dd2c6cc34d0d66, c0e40697aec547df8452e2db15489c65; no voters:
I20260812 01:18:07.383505 21550 raft_consensus.cc:2781] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:18:07.383580 21550 raft_consensus.cc:482] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:18:07.383607 21550 raft_consensus.cc:3037] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:07.384344 21550 raft_consensus.cc:504] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 38551 } } peers { permanent_uuid: "d589d405d7de43f0815753b3694ea4b0" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 42147 } } peers { permanent_uuid: "c0e40697aec547df8452e2db15489c65" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 46751 } }
I20260812 01:18:07.384527 21550 leader_election.cc:288] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [CANDIDATE]: Term 1 election: Requested vote from peers d589d405d7de43f0815753b3694ea4b0 (127.17.183.131:42147), c0e40697aec547df8452e2db15489c65 (127.17.183.129:46751)
I20260812 01:18:07.384670 21444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f198b6f849c64cdf807eb3e981bd0145" candidate_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d589d405d7de43f0815753b3694ea4b0"
I20260812 01:18:07.384676 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f198b6f849c64cdf807eb3e981bd0145" candidate_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e40697aec547df8452e2db15489c65"
I20260812 01:18:07.384765 20970 raft_consensus.cc:3037] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:07.384769 21444 raft_consensus.cc:3037] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:07.385569 21444 raft_consensus.cc:2454] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e0c00fe0ac145b689dd2c6cc34d0d66 in term 1.
I20260812 01:18:07.385579 20970 raft_consensus.cc:2454] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e0c00fe0ac145b689dd2c6cc34d0d66 in term 1.
I20260812 01:18:07.385782 21078 leader_election.cc:302] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e0c00fe0ac145b689dd2c6cc34d0d66, c0e40697aec547df8452e2db15489c65; no voters:
I20260812 01:18:07.385912 21550 raft_consensus.cc:2781] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:07.386070 21550 raft_consensus.cc:686] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 1 LEADER]: Becoming Leader. State: Replica: 8e0c00fe0ac145b689dd2c6cc34d0d66, State: Running, Role: LEADER
I20260812 01:18:07.386143 21550 consensus_queue.cc:237] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 38551 } } peers { permanent_uuid: "d589d405d7de43f0815753b3694ea4b0" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 42147 } } peers { permanent_uuid: "c0e40697aec547df8452e2db15489c65" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 46751 } }
I20260812 01:18:07.386999 20716 catalog_manager.cc:5495] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e0c00fe0ac145b689dd2c6cc34d0d66 (127.17.183.130). New cstate: current_term: 1 leader_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e0c00fe0ac145b689dd2c6cc34d0d66" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d589d405d7de43f0815753b3694ea4b0" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e40697aec547df8452e2db15489c65" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 46751 } health_report { overall_health: UNKNOWN } } }
I20260812 01:18:07.460537 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.458163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58778 (local address 127.17.183.130:38551)
0812 01:18:07.458226 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:07.458228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:07.458241 (+ 13us) server_negotiation.cc:407] Connection header received
0812 01:18:07.458280 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:07.458281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:07.458320 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:07.458399 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:07.458520 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.458998 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.459775 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:07.459968 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:07.460021 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:07.460183 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:07.460277 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:07.460347 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:07.460395 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 01:18:07.460405 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 01:18:07.462810 21444 raft_consensus.cc:1261] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0 [term 1 FOLLOWER]: Refusing update from remote peer 8e0c00fe0ac145b689dd2c6cc34d0d66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:07.462819 20970 raft_consensus.cc:1261] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65 [term 1 FOLLOWER]: Refusing update from remote peer 8e0c00fe0ac145b689dd2c6cc34d0d66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:07.463239 21557 consensus_queue.cc:1035] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e40697aec547df8452e2db15489c65" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 46751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:07.463406 21550 consensus_queue.cc:1035] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d589d405d7de43f0815753b3694ea4b0" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:07.465828 21562 mvcc.cc:205] Tried to move back new op lower bound from 7317493708644458496 to 7317493708334292992. Current Snapshot: MvccSnapshot[applied={T|T < 7317493708644458496}]
I20260812 01:18:07.466076 21564 mvcc.cc:205] Tried to move back new op lower bound from 7317493708644458496 to 7317493708334292992. Current Snapshot: MvccSnapshot[applied={T|T < 7317493708644458496}]
I20260812 01:18:07.468341 20716 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:07.468456 20716 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:07.469378 20716 catalog_manager.cc:5782] T 00000000000000000000000000000000 P af4c02e1c06748208a5ea1a05ff5f795: Sending DeleteTablet for 3 replicas of tablet f198b6f849c64cdf807eb3e981bd0145
I20260812 01:18:07.469707 21169 tablet_service.cc:1514] Processing DeleteTablet for tablet f198b6f849c64cdf807eb3e981bd0145 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:07 UTC) from {username='slave'} at 127.0.0.1:58772
I20260812 01:18:07.469720 21411 tablet_service.cc:1514] Processing DeleteTablet for tablet f198b6f849c64cdf807eb3e981bd0145 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:07 UTC) from {username='slave'} at 127.0.0.1:39368
I20260812 01:18:07.469726 20935 tablet_service.cc:1514] Processing DeleteTablet for tablet f198b6f849c64cdf807eb3e981bd0145 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:07 UTC) from {username='slave'} at 127.0.0.1:46754
I20260812 01:18:07.469978 21577 tablet_replica.cc:330] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: stopping tablet replica
I20260812 01:18:07.470046 21580 tablet_replica.cc:330] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: stopping tablet replica
I20260812 01:18:07.470088 21577 raft_consensus.cc:2229] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:18:07.470122 21580 raft_consensus.cc:2229] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:18:07.470175 21577 raft_consensus.cc:2258] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:07.470211 21580 raft_consensus.cc:2258] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:07.470341 21578 tablet_replica.cc:330] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65: stopping tablet replica
I20260812 01:18:07.470429 21578 raft_consensus.cc:2229] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:18:07.470433 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 20819
I20260812 01:18:07.470546 21578 raft_consensus.cc:2258] T f198b6f849c64cdf807eb3e981bd0145 P c0e40697aec547df8452e2db15489c65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:07.470690 21577 ts_tablet_manager.cc:1905] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:07.476133 21577 ts_tablet_manager.cc:1918] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:07.476195 21577 log.cc:1196] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/f198b6f849c64cdf807eb3e981bd0145
I20260812 01:18:07.476397 21577 ts_tablet_manager.cc:1939] T f198b6f849c64cdf807eb3e981bd0145 P 8e0c00fe0ac145b689dd2c6cc34d0d66: Deleting consensus metadata
I20260812 01:18:07.477022 21580 ts_tablet_manager.cc:1905] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:07.479096 21580 ts_tablet_manager.cc:1918] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:07.479184 21580 log.cc:1196] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/f198b6f849c64cdf807eb3e981bd0145
I20260812 01:18:07.479297 20697 catalog_manager.cc:4841] TS 8e0c00fe0ac145b689dd2c6cc34d0d66 (127.17.183.130:38551): tablet f198b6f849c64cdf807eb3e981bd0145 (table test-table [id=f17ba124734f40999a532e226bf64eb2]) successfully deleted
I20260812 01:18:07.479458 21580 ts_tablet_manager.cc:1939] T f198b6f849c64cdf807eb3e981bd0145 P d589d405d7de43f0815753b3694ea4b0: Deleting consensus metadata
I20260812 01:18:07.479887 20693 catalog_manager.cc:4841] TS d589d405d7de43f0815753b3694ea4b0 (127.17.183.131:42147): tablet f198b6f849c64cdf807eb3e981bd0145 (table test-table [id=f17ba124734f40999a532e226bf64eb2]) successfully deleted
W20260812 01:18:07.489895 20697 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:46751 (error 108)
I20260812 01:18:07.490180 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 21045
I20260812 01:18:07.490473 21539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:07.490312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:46751 (local address 127.0.0.1:46760)
0812 01:18:07.490365 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:07.490427 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 01:18:07.490620 20697 catalog_manager.cc:4584] TS c0e40697aec547df8452e2db15489c65 (127.17.183.129:46751): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f198b6f849c64cdf807eb3e981bd0145: Network error: Client connection negotiation failed: client connection to 127.17.183.129:46751: connect: Connection refused (error 111)
I20260812 01:18:07.502449 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 21300
I20260812 01:18:07.516408 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 20661
2026-08-12T01:18:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1149 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:07 dist-test-slave-rwrg krb5kdc[21587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:07 dist-test-slave-rwrg krb5kdc[21587](info): set up 2 sockets
Aug 12 01:18:07 dist-test-slave-rwrg krb5kdc[21587](info): commencing operation
krb5kdc: starting...
W20260812 01:18:08.806847 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:08 dist-test-slave-rwrg krb5kdc[21587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497488, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:18:08.929697 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33893
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:33893
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:09.011894 21615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:09.012087 21615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:09.012109 21615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:09.013252 21615 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:09.013296 21615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:09.013310 21615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:09.013322 21615 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:09.013334 21615 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:09.014851 21615 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:33893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:09.015151 21615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:09.015426 21615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:09.020358 21626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:09.020512 21615 server_base.cc:1034] running on GCE node
W20260812 01:18:09.020367 21630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:09.020367 21621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:09.020908 21615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:09.021220 21615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:09.022421 21615 hybrid_clock.cc:648] HybridClock initialized: now 1786497489022397 us; error 36 us; skew 500 ppm
Aug 12 01:18:09 dist-test-slave-rwrg krb5kdc[21587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:09.025213 21615 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:18:09.025702 21615 webserver.cc:460] Webserver started at http://127.17.183.190:41525/ using document root <none> and password file <none>
I20260812 01:18:09.025959 21615 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:09.026033 21615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:09.026180 21615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:09.027256 21615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "497d6d77945341adaf41f75136b6acbe"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "dd4b2a27464c318b55bc0cc21331635b"
server_key_iv: "6c763346e8e6d6152c703e7653af7345"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.027628 21615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "497d6d77945341adaf41f75136b6acbe"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "dd4b2a27464c318b55bc0cc21331635b"
server_key_iv: "6c763346e8e6d6152c703e7653af7345"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.029045 21615 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:18:09.029850 21639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:09.030032 21615 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:09.030125 21615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "497d6d77945341adaf41f75136b6acbe"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "dd4b2a27464c318b55bc0cc21331635b"
server_key_iv: "6c763346e8e6d6152c703e7653af7345"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.030208 21615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:09.042065 21615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:09.043994 21615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:09.044162 21615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:09.048550 21615 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:33893
I20260812 01:18:09.048584 21721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:33893 every 8 connection(s)
I20260812 01:18:09.048952 21615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:09.049854 21724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:09.052173 21724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe: Bootstrap starting.
I20260812 01:18:09.052892 21724 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:09.053244 21724 log.cc:824] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:09.054003 21724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe: No bootstrap required, opened a new log
I20260812 01:18:09.054644 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 21615
I20260812 01:18:09.054778 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:09.054994 18142 external_mini_cluster.cc:1428] Setting key f761000d6c661ba17f9626e8391b4971
I20260812 01:18:09.056305 21724 raft_consensus.cc:348] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497d6d77945341adaf41f75136b6acbe" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33893 } }
I20260812 01:18:09.056481 21724 raft_consensus.cc:374] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:09.056560 21724 raft_consensus.cc:729] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497d6d77945341adaf41f75136b6acbe, State: Initialized, Role: FOLLOWER
I20260812 01:18:09.056703 21724 consensus_queue.cc:260] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497d6d77945341adaf41f75136b6acbe" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33893 } }
I20260812 01:18:09.056809 21724 raft_consensus.cc:388] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:09.056859 21724 raft_consensus.cc:482] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:09.056908 21724 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:09.057574 21724 raft_consensus.cc:504] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497d6d77945341adaf41f75136b6acbe" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33893 } }
I20260812 01:18:09.057665 21724 leader_election.cc:302] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 497d6d77945341adaf41f75136b6acbe; no voters:
I20260812 01:18:09.057883 21724 leader_election.cc:288] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:09.057927 21731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:09.058068 21731 raft_consensus.cc:686] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [term 1 LEADER]: Becoming Leader. State: Replica: 497d6d77945341adaf41f75136b6acbe, State: Running, Role: LEADER
I20260812 01:18:09.058173 21724 sys_catalog.cc:564] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:09.058156 21731 consensus_queue.cc:237] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497d6d77945341adaf41f75136b6acbe" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33893 } }
I20260812 01:18:09.058485 21732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "497d6d77945341adaf41f75136b6acbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497d6d77945341adaf41f75136b6acbe" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33893 } } }
I20260812 01:18:09.058578 21732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:09.058485 21733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 497d6d77945341adaf41f75136b6acbe. Latest consensus state: current_term: 1 leader_uuid: "497d6d77945341adaf41f75136b6acbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497d6d77945341adaf41f75136b6acbe" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33893 } } }
I20260812 01:18:09.058833 21733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:09.059465 21740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:09.060014 21740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:09.061676 21740 catalog_manager.cc:1347] Generated new cluster ID: c9e10bf3acbd4de5aec2dcf5d5b55051
I20260812 01:18:09.061750 21740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:18:09 dist-test-slave-rwrg krb5kdc[21587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497488, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:09.066776 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.055558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48404 (local address 127.17.183.190:33893)
0812 01:18:09.055739 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.055747 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.055772 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:18:09.056277 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.056283 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.056329 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.056438 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:09.057291 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.058622 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.059897 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.060385 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.060546 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.063111 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:09.063114 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:09.063114 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:09.063125 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:09.065132 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:09.065542 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:09.065545 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:09.065546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:09.065663 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:09.065888 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:09.065889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:09.065889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:09.066119 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:09.066305 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.066384 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.066630 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260812 01:18:09.084960 21740 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:09.085695 21740 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:09.092927 21740 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe: Generated new TSK 0
I20260812 01:18:09.093158 21740 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.183.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
Entry for principal kudu/127.17.183.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab.
I20260812 01:18:09.130695 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33893
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:09.222366 21758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:09.222553 21758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:09.222575 21758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:09.223591 21758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:09.223624 21758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:09.223649 21758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:18:09.225099 21758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.129.keytab
--principal=kudu/127.17.183.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:09.225287 21758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:09.225461 21758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:09.230424 21767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:09.230443 21771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:09.230475 21778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:09.230592 21758 server_base.cc:1034] running on GCE node
I20260812 01:18:09.230912 21758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:09.231148 21758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:09.232334 21758 hybrid_clock.cc:648] HybridClock initialized: now 1786497489232328 us; error 36 us; skew 500 ppm
Aug 12 01:18:09 dist-test-slave-rwrg krb5kdc[21587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:09.235093 21758 init.cc:377] Logged in from keytab as kudu/127.17.183.129@KRBTEST.COM (short username kudu)
I20260812 01:18:09.235541 21758 webserver.cc:460] Webserver started at http://127.17.183.129:41713/ using document root <none> and password file <none>
I20260812 01:18:09.235750 21758 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:09.235790 21758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:09.235877 21758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:09.236958 21758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "d8140523412b4097bfd606b5ab5112ca"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "292c68cfb04ee2b7d31008e82a841265"
server_key_iv: "14217b6d376c8a95bc3e165c48cbc4c1"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.237267 21758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "d8140523412b4097bfd606b5ab5112ca"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "292c68cfb04ee2b7d31008e82a841265"
server_key_iv: "14217b6d376c8a95bc3e165c48cbc4c1"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.238546 21758 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:09.239267 21787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:09.239444 21758 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:09.239529 21758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "d8140523412b4097bfd606b5ab5112ca"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "292c68cfb04ee2b7d31008e82a841265"
server_key_iv: "14217b6d376c8a95bc3e165c48cbc4c1"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.239584 21758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:09.247391 21758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:09.249564 21758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:09.249684 21758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:09.249857 21758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:09.250192 21758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:09.250226 21758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:09.250248 21758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:09.250298 21758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:09.256346 21758 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:38373
I20260812 01:18:09.256430 21987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:38373 every 8 connection(s)
I20260812 01:18:09.256762 21758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
Aug 12 01:18:09 dist-test-slave-rwrg krb5kdc[21587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.129@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:09.266490 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.257524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:48625 (local address 127.17.183.190:33893)
0812 01:18:09.257591 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.257593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.257819 (+ 226us) server_negotiation.cc:407] Connection header received
0812 01:18:09.258434 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.258436 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.258453 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.258509 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:09.259630 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.260138 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.261221 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.261433 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.261553 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.263875 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:09.263877 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:09.263877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:09.263885 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:09.265229 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:09.265626 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:09.265627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:09.265627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:09.265676 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:09.265928 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:09.265928 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:09.265929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:09.266054 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:09.266119 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.266357 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.266425 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 01:18:09.266641 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.257476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33893 (local address 127.17.183.129:48625)
0812 01:18:09.257693 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:09.257732 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:09.258315 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:09.258597 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:09.258603 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:09.259316 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:09.259521 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.259526 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.260252 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.260253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.261131 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.261133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.261571 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.261573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.261702 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.262196 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:09.262204 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:09.263772 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:09.265309 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:09.265316 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:09.265317 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:09.265555 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:09.265737 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:09.265738 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:09.265738 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:09.265839 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:09.266126 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:09.266131 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:09.266243 (+ 112us) client_negotiation.cc:769] Sending connection context
0812 01:18:09.266328 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 01:18:09.266441 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":126,"threads_started":1}
I20260812 01:18:09.266985 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 21758
I20260812 01:18:09.267125 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:18:09.267220 21988 heartbeater.cc:347] Connected to a master server at 127.17.183.190:33893
I20260812 01:18:09.267320 21988 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:09.267401 18142 external_mini_cluster.cc:1428] Setting key 030642e59a64c89df93a22c200ae384f
I20260812 01:18:09.267542 21988 heartbeater.cc:511] Master 127.17.183.190:33893 requested a full tablet report, sending...
I20260812 01:18:09.268177 21661 ts_manager.cc:194] Registered new tserver with Master: d8140523412b4097bfd606b5ab5112ca (127.17.183.129:38373)
I20260812 01:18:09.269088 21661 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.129@KRBTEST.COM'} at 127.17.183.129:48625
WARNING: no policy specified for kudu/127.17.183.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
Entry for principal kudu/127.17.183.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab.
I20260812 01:18:09.294860 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33893
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:09.377820 21994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:09.378021 21994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:09.378043 21994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:09.379146 21994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:09.379185 21994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:09.379210 21994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:18:09.380772 21994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.130.keytab
--principal=kudu/127.17.183.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:09.381045 21994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:09.381268 21994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:09.386395 22002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:09.386442 21994 server_base.cc:1034] running on GCE node
W20260812 01:18:09.386395 22005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:09.386404 22007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:09.386861 21994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:09.387104 21994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:09.388273 21994 hybrid_clock.cc:648] HybridClock initialized: now 1786497489388268 us; error 36 us; skew 500 ppm
Aug 12 01:18:09 dist-test-slave-rwrg krb5kdc[21587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:09.390952 21994 init.cc:377] Logged in from keytab as kudu/127.17.183.130@KRBTEST.COM (short username kudu)
I20260812 01:18:09.391362 21994 webserver.cc:460] Webserver started at http://127.17.183.130:38175/ using document root <none> and password file <none>
I20260812 01:18:09.391597 21994 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:09.391664 21994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:09.391820 21994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:09.392935 21994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "c479bceccb452ed7010dac20bc68c208"
server_key_iv: "13229ca33a819584e39de7eb7a25d172"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.393307 21994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "c479bceccb452ed7010dac20bc68c208"
server_key_iv: "13229ca33a819584e39de7eb7a25d172"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.394672 21994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:18:09.395406 22018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:09.395591 21994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:09.395700 21994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "c479bceccb452ed7010dac20bc68c208"
server_key_iv: "13229ca33a819584e39de7eb7a25d172"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.395784 21994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:09.407567 21994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:09.409601 21994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:09.409775 21994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:09.410032 21994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:09.410359 21994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:09.410418 21994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:09.410461 21994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:09.410487 21994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:09.416620 21994 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:39023
I20260812 01:18:09.416719 22251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:39023 every 8 connection(s)
I20260812 01:18:09.417025 21994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:18:09.420142 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 21994
I20260812 01:18:09.420286 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:18:09.420543 18142 external_mini_cluster.cc:1428] Setting key ee5396c6e16f04fd2b27860a9642e822
Aug 12 01:18:09 dist-test-slave-rwrg krb5kdc[21587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.130@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:09.427222 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.417732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:55501 (local address 127.17.183.190:33893)
0812 01:18:09.417804 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.417807 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.418055 (+ 248us) server_negotiation.cc:407] Connection header received
0812 01:18:09.418609 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.418610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.418623 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.418674 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:09.419596 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.420088 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.421502 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.421703 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.421779 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.424040 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:09.424042 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:09.424042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:09.424050 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:09.425731 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:09.426129 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:09.426131 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:09.426131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:09.426195 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:09.426530 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:09.426531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:09.426531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:09.426686 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:09.426761 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.427036 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.427131 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 01:18:09.427407 22254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.417708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33893 (local address 127.17.183.130:55501)
0812 01:18:09.417917 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:09.417969 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:09.418485 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:09.418745 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:09.418749 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:09.419291 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:09.419480 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.419484 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.420193 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.420195 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.421419 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.421422 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.421800 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.421801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.421940 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.422470 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:09.422478 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:09.423943 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:09.425815 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:09.425822 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:09.425824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:09.426036 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:09.426284 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:09.426284 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:09.426285 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:09.426455 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:09.426757 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:09.426763 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:09.426888 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 01:18:09.426995 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 01:18:09.427150 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":127,"threads_started":1}
I20260812 01:18:09.427990 22252 heartbeater.cc:347] Connected to a master server at 127.17.183.190:33893
I20260812 01:18:09.428105 22252 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:09.428308 22252 heartbeater.cc:511] Master 127.17.183.190:33893 requested a full tablet report, sending...
I20260812 01:18:09.428726 21661 ts_manager.cc:194] Registered new tserver with Master: bdbeddeca98c4d5ea3aca3a737d21ca0 (127.17.183.130:39023)
I20260812 01:18:09.429121 21661 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.130@KRBTEST.COM'} at 127.17.183.130:55501
WARNING: no policy specified for kudu/127.17.183.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
Entry for principal kudu/127.17.183.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab.
I20260812 01:18:09.447329 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33893
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:43637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:09.530148 22258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:09.530385 22258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:09.530423 22258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:09.531543 22258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:09.531615 22258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:09.531659 22258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:18:09.533203 22258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:43637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.131.keytab
--principal=kudu/127.17.183.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:33893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:09.533478 22258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:09.533737 22258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:09.538848 22272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:09.538928 22269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:09.538882 22275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:09.539121 22258 server_base.cc:1034] running on GCE node
I20260812 01:18:09.539299 22258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:09.539494 22258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:09.540635 22258 hybrid_clock.cc:648] HybridClock initialized: now 1786497489540612 us; error 26 us; skew 500 ppm
Aug 12 01:18:09 dist-test-slave-rwrg krb5kdc[21587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:09.543073 22258 init.cc:377] Logged in from keytab as kudu/127.17.183.131@KRBTEST.COM (short username kudu)
I20260812 01:18:09.543524 22258 webserver.cc:460] Webserver started at http://127.17.183.131:44425/ using document root <none> and password file <none>
I20260812 01:18:09.543752 22258 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:09.543828 22258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:09.543982 22258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:09.545125 22258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "1e50e33cc894496ca8e566d8db26ddb6"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "d906b0179eb50e5bed0068c3c0b2bdc4"
server_key_iv: "b97311c82df08884c1d00f010097ec32"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.545486 22258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "1e50e33cc894496ca8e566d8db26ddb6"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "d906b0179eb50e5bed0068c3c0b2bdc4"
server_key_iv: "b97311c82df08884c1d00f010097ec32"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.546829 22258 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:18:09.547540 22289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:09.547705 22258 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:09.547807 22258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "1e50e33cc894496ca8e566d8db26ddb6"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "d906b0179eb50e5bed0068c3c0b2bdc4"
server_key_iv: "b97311c82df08884c1d00f010097ec32"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.547876 22258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:09.566601 22258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:09.568432 22258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:09.568740 22258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:09.569064 22258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:09.569460 22258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:09.569496 22258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:09.569525 22258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:09.569542 22258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:09.575673 22258 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:37289
I20260812 01:18:09.575726 22502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:37289 every 8 connection(s)
I20260812 01:18:09.576026 22258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
Aug 12 01:18:09 dist-test-slave-rwrg krb5kdc[21587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.131@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:09.582522 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 22258
I20260812 01:18:09.582626 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:18:09.582862 18142 external_mini_cluster.cc:1428] Setting key f32c9a3db49f2471c72a42e9ea9897ee
I20260812 01:18:09.585888 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.576745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:46693 (local address 127.17.183.190:33893)
0812 01:18:09.576798 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.576800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.577018 (+ 218us) server_negotiation.cc:407] Connection header received
0812 01:18:09.577573 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.577575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.577589 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.577653 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:09.578631 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.579124 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.580105 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.580303 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.580384 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.582796 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:09.582797 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:09.582798 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:09.582806 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:09.584425 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:09.584860 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:09.584862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:09.584863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:09.584946 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:09.585208 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:09.585209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:09.585210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:09.585339 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:09.585414 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.585705 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.585791 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 01:18:09.586081 22511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.576701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:33893 (local address 127.17.183.131:46693)
0812 01:18:09.576851 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:09.576902 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:09.577459 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:09.577724 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:09.577729 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:09.578320 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:09.578508 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.578513 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.579226 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.579227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.580005 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.580007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.580394 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.580396 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.580541 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.581125 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:09.581133 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:09.582680 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:09.584530 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:09.584539 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:09.584542 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:09.584779 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:09.585026 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:09.585026 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:09.585027 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:09.585140 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:09.585417 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:09.585425 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:09.585563 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 01:18:09.585668 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 01:18:09.585838 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":71,"threads_started":1}
I20260812 01:18:09.586591 22504 heartbeater.cc:347] Connected to a master server at 127.17.183.190:33893
I20260812 01:18:09.586684 22504 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:09.586839 22504 heartbeater.cc:511] Master 127.17.183.190:33893 requested a full tablet report, sending...
I20260812 01:18:09.587249 21661 ts_manager.cc:194] Registered new tserver with Master: 1e50e33cc894496ca8e566d8db26ddb6 (127.17.183.131:37289)
I20260812 01:18:09.587802 21661 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.183.131@KRBTEST.COM'} at 127.17.183.131:46693
I20260812 01:18:09.594611 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:18:09.601617 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.595824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48408 (local address 127.17.183.190:33893)
0812 01:18:09.595911 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.595913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.595987 (+ 74us) server_negotiation.cc:407] Connection header received
0812 01:18:09.596069 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.596070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.596079 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.596124 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:09.596727 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.597171 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.597946 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.598144 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.598224 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.599348 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:09.599349 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:09.599350 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:09.599357 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:09.600437 (+ 1080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:09.600781 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:09.600782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:09.600783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:09.600833 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:09.601055 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:09.601055 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:09.601056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:09.601197 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:09.601296 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.601428 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.601516 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 01:18:09.602938 21661 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48408:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:18:09.604426 21661 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:18:09.611066 22528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.606827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:39023 (local address 127.0.0.1:43618)
0812 01:18:09.607126 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:09.607136 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:09.607193 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:09.607481 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:09.607484 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:09.607487 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:09.607549 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.607551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.608621 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.608622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.609893 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.609895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.610705 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.610706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.610830 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.610848 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 01:18:09.610919 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 01:18:09.610977 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":2,"spinlock_wait_cycles":1408,"thread_start_us":108,"threads_started":1}
I20260812 01:18:09.611208 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.606966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50562 (local address 127.17.183.131:37289)
0812 01:18:09.607340 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.607344 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.607355 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:18:09.607392 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.607394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.607408 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.607741 (+ 333us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:09.607811 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.608850 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.610109 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.610778 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.610868 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.610928 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.611010 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.611052 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":79,"threads_started":1}
I20260812 01:18:09.611531 22538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.606958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43618 (local address 127.17.183.130:39023)
0812 01:18:09.607262 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.607266 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.607275 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:18:09.607311 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.607312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.607332 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.607415 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:09.607654 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.608490 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.609979 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.610614 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.610706 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.610777 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.611427 (+ 650us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.611468 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":81,"threads_started":1}
I20260812 01:18:09.611589 22542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.607277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36566 (local address 127.17.183.129:38373)
0812 01:18:09.607671 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.607676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.607686 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:18:09.607745 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.607747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.607762 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.607841 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:09.608048 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.609064 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.610328 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.611049 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.611128 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.611180 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.611492 (+ 312us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.611531 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":93,"threads_started":1}
I20260812 01:18:09.611128 22533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.606827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:37289 (local address 127.0.0.1:50562)
0812 01:18:09.607012 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:09.607055 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:09.607118 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:09.607562 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:09.607564 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:09.607566 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:09.607622 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.607624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.608954 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.608955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.610009 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.610017 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.610870 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.610871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.610934 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.610937 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:18:09.610995 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 01:18:09.611027 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":69,"threads_started":1}
I20260812 01:18:09.611438 22540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.607046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:38373 (local address 127.0.0.1:36566)
0812 01:18:09.607161 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:09.607170 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:09.607213 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:09.607920 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:09.607921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:09.607922 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:09.607955 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.607956 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.609167 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.609168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.610227 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.610230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.611219 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.611221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.611290 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.611294 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:09.611346 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 01:18:09.611385 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":74,"threads_started":1}
I20260812 01:18:09.612649 22115 tablet_service.cc:1467] Processing CreateTablet for tablet a6c5214ceddf46e3968654457dc1b29a (DEFAULT_TABLE table=test-table [id=b75bd4e55e034f8db7a6d3d7a6761fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:09.612627 22381 tablet_service.cc:1467] Processing CreateTablet for tablet a6c5214ceddf46e3968654457dc1b29a (DEFAULT_TABLE table=test-table [id=b75bd4e55e034f8db7a6d3d7a6761fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:09.612615 21877 tablet_service.cc:1467] Processing CreateTablet for tablet a6c5214ceddf46e3968654457dc1b29a (DEFAULT_TABLE table=test-table [id=b75bd4e55e034f8db7a6d3d7a6761fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:09.613004 22115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c5214ceddf46e3968654457dc1b29a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:09.613005 22381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c5214ceddf46e3968654457dc1b29a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:09.613013 21877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c5214ceddf46e3968654457dc1b29a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:09.616361 22547 tablet_bootstrap.cc:492] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6: Bootstrap starting.
I20260812 01:18:09.616521 22543 tablet_bootstrap.cc:492] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca: Bootstrap starting.
I20260812 01:18:09.616621 22544 tablet_bootstrap.cc:492] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: Bootstrap starting.
I20260812 01:18:09.617143 22547 tablet_bootstrap.cc:654] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:09.617255 22543 tablet_bootstrap.cc:654] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:09.617255 22544 tablet_bootstrap.cc:654] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:09.617688 22547 log.cc:824] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:09.617879 22544 log.cc:824] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:09.617906 22543 log.cc:824] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:09.618608 22543 tablet_bootstrap.cc:492] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca: No bootstrap required, opened a new log
I20260812 01:18:09.618610 22547 tablet_bootstrap.cc:492] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6: No bootstrap required, opened a new log
I20260812 01:18:09.618690 22543 ts_tablet_manager.cc:1397] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:18:09.618698 22547 ts_tablet_manager.cc:1397] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:18:09.618793 22544 tablet_bootstrap.cc:492] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: No bootstrap required, opened a new log
I20260812 01:18:09.618856 22544 ts_tablet_manager.cc:1397] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:18:09.620193 22544 raft_consensus.cc:348] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 } } peers { permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 } } peers { permanent_uuid: "d8140523412b4097bfd606b5ab5112ca" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38373 } }
I20260812 01:18:09.620327 22544 raft_consensus.cc:374] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:09.620366 22544 raft_consensus.cc:729] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbeddeca98c4d5ea3aca3a737d21ca0, State: Initialized, Role: FOLLOWER
I20260812 01:18:09.620487 22544 consensus_queue.cc:260] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 } } peers { permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 } } peers { permanent_uuid: "d8140523412b4097bfd606b5ab5112ca" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38373 } }
I20260812 01:18:09.620807 22544 ts_tablet_manager.cc:1428] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:18:09.620820 22252 heartbeater.cc:503] Master 127.17.183.190:33893 was elected leader, sending a full tablet report...
I20260812 01:18:09.620808 22543 raft_consensus.cc:348] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 } } peers { permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 } } peers { permanent_uuid: "d8140523412b4097bfd606b5ab5112ca" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38373 } }
I20260812 01:18:09.620805 22547 raft_consensus.cc:348] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 } } peers { permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 } } peers { permanent_uuid: "d8140523412b4097bfd606b5ab5112ca" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38373 } }
I20260812 01:18:09.620990 22543 raft_consensus.cc:374] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:09.620990 22547 raft_consensus.cc:374] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:09.621026 22543 raft_consensus.cc:729] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8140523412b4097bfd606b5ab5112ca, State: Initialized, Role: FOLLOWER
I20260812 01:18:09.621026 22547 raft_consensus.cc:729] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e50e33cc894496ca8e566d8db26ddb6, State: Initialized, Role: FOLLOWER
I20260812 01:18:09.621140 22547 consensus_queue.cc:260] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 } } peers { permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 } } peers { permanent_uuid: "d8140523412b4097bfd606b5ab5112ca" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38373 } }
I20260812 01:18:09.621138 22543 consensus_queue.cc:260] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 } } peers { permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 } } peers { permanent_uuid: "d8140523412b4097bfd606b5ab5112ca" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38373 } }
I20260812 01:18:09.621444 22547 ts_tablet_manager.cc:1428] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:18:09.621444 22543 ts_tablet_manager.cc:1428] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:18:09.621479 21988 heartbeater.cc:503] Master 127.17.183.190:33893 was elected leader, sending a full tablet report...
I20260812 01:18:09.621555 22504 heartbeater.cc:503] Master 127.17.183.190:33893 was elected leader, sending a full tablet report...
W20260812 01:18:09.667706 22253 tablet.cc:2369] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:18:09.686719 22562 raft_consensus.cc:482] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:18:09.686853 22562 raft_consensus.cc:504] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 } } peers { permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 } } peers { permanent_uuid: "d8140523412b4097bfd606b5ab5112ca" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38373 } }
I20260812 01:18:09.687294 22562 leader_election.cc:288] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e50e33cc894496ca8e566d8db26ddb6 (127.17.183.131:37289), bdbeddeca98c4d5ea3aca3a737d21ca0 (127.17.183.130:39023)
I20260812 01:18:09.688930 22561 raft_consensus.cc:482] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:18:09.689050 22561 raft_consensus.cc:504] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 } } peers { permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 } } peers { permanent_uuid: "d8140523412b4097bfd606b5ab5112ca" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38373 } }
I20260812 01:18:09.689414 22561 leader_election.cc:288] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbeddeca98c4d5ea3aca3a737d21ca0 (127.17.183.130:39023), d8140523412b4097bfd606b5ab5112ca (127.17.183.129:38373)
I20260812 01:18:09.691121 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.687515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:37289 (local address 127.17.183.129:37085)
0812 01:18:09.687586 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:09.687603 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:09.687665 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:09.687876 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:09.687877 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:09.687879 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:09.687963 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.687964 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.688728 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.688729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.689995 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.689997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.690844 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.690845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.690944 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.690947 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:18:09.691005 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 01:18:09.691046 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 01:18:09.691181 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.687667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:37085 (local address 127.17.183.131:37289)
0812 01:18:09.687732 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.687734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.687742 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:18:09.687781 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.687782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.687789 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.687854 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:09.688061 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.688642 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.690105 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.690757 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.690833 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.690840 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.691053 (+ 213us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.691103 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 01:18:09.691509 22415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c5214ceddf46e3968654457dc1b29a" candidate_uuid: "d8140523412b4097bfd606b5ab5112ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e50e33cc894496ca8e566d8db26ddb6" is_pre_election: true
I20260812 01:18:09.691635 22415 raft_consensus.cc:2454] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8140523412b4097bfd606b5ab5112ca in term 0.
I20260812 01:18:09.691843 22538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.687616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:57805 (local address 127.17.183.130:39023)
0812 01:18:09.687666 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.687669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.687877 (+ 208us) server_negotiation.cc:407] Connection header received
0812 01:18:09.687977 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.687978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.687987 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.688059 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:09.688218 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.688694 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.690107 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.690640 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.690675 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.690682 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.691740 (+ 1058us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.691783 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:18:09.691856 21788 leader_election.cc:302] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e50e33cc894496ca8e566d8db26ddb6, d8140523412b4097bfd606b5ab5112ca; no voters:
I20260812 01:18:09.692067 22563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.687514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:39023 (local address 127.17.183.129:57805)
0812 01:18:09.687800 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:09.687809 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:09.687890 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:09.688064 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:09.688064 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:09.688066 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:09.688144 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.688145 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.688821 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.688822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.690006 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.690009 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.690729 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.690730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.690784 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.690786 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:18:09.691967 (+ 1181us) client_negotiation.cc:240] Negotiation successful
0812 01:18:09.692006 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":75,"thread_start_us":129,"threads_started":1}
I20260812 01:18:09.692382 22156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c5214ceddf46e3968654457dc1b29a" candidate_uuid: "d8140523412b4097bfd606b5ab5112ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" is_pre_election: true
I20260812 01:18:09.692575 22156 raft_consensus.cc:2454] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8140523412b4097bfd606b5ab5112ca in term 0.
I20260812 01:18:09.692574 22562 raft_consensus.cc:2781] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:18:09.692637 22562 raft_consensus.cc:482] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:18:09.692684 22562 raft_consensus.cc:3037] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:09.693605 22565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.689612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:38373 (local address 127.17.183.131:56761)
0812 01:18:09.689858 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:09.689868 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:09.689914 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:09.690106 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:09.690107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:09.690109 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:09.690182 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.690185 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.691131 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.691132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.692417 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.692420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.693324 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.693325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.693401 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.693407 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 01:18:09.693471 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 01:18:09.693517 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":80,"threads_started":1}
I20260812 01:18:09.693574 22542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.689781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:56761 (local address 127.17.183.129:38373)
0812 01:18:09.689959 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.689961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.689970 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:18:09.689992 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.689993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.690002 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.690060 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:09.690302 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.691039 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.692544 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.693229 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.693304 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.693313 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.693484 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.693520 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
I20260812 01:18:09.693570 22562 raft_consensus.cc:504] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 } } peers { permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 } } peers { permanent_uuid: "d8140523412b4097bfd606b5ab5112ca" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38373 } }
I20260812 01:18:09.693724 22562 leader_election.cc:288] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [CANDIDATE]: Term 1 election: Requested vote from peers 1e50e33cc894496ca8e566d8db26ddb6 (127.17.183.131:37289), bdbeddeca98c4d5ea3aca3a737d21ca0 (127.17.183.130:39023)
I20260812 01:18:09.693857 22415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c5214ceddf46e3968654457dc1b29a" candidate_uuid: "d8140523412b4097bfd606b5ab5112ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e50e33cc894496ca8e566d8db26ddb6"
I20260812 01:18:09.693881 22156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c5214ceddf46e3968654457dc1b29a" candidate_uuid: "d8140523412b4097bfd606b5ab5112ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0"
I20260812 01:18:09.693928 22415 raft_consensus.cc:3037] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:09.693986 22156 raft_consensus.cc:3037] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:09.694262 22511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.689579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:39023 (local address 127.17.183.131:53889)
0812 01:18:09.689674 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:09.689685 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:09.689727 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:09.690216 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:09.690217 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:09.690219 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:09.690324 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.690327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.692196 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.692197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.693234 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:09.693247 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.693990 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.693992 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:09.694087 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.694091 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:09.694126 (+ 35us) client_negotiation.cc:240] Negotiation successful
0812 01:18:09.694176 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":42}
I20260812 01:18:09.694504 22566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.689804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:53889 (local address 127.17.183.130:39023)
0812 01:18:09.690086 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.690088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.690095 (+ 7us) server_negotiation.cc:407] Connection header received
0812 01:18:09.690112 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.690112 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.690121 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.690234 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:09.690950 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.691635 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.693335 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.693886 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.694370 (+ 484us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.694379 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.694399 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.694431 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":621,"server-negotiator.queue_time_us":256,"thread_start_us":112,"threads_started":1}
I20260812 01:18:09.694921 22415 raft_consensus.cc:2454] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8140523412b4097bfd606b5ab5112ca in term 1.
I20260812 01:18:09.694917 21909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c5214ceddf46e3968654457dc1b29a" candidate_uuid: "1e50e33cc894496ca8e566d8db26ddb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8140523412b4097bfd606b5ab5112ca" is_pre_election: true
I20260812 01:18:09.695051 21909 raft_consensus.cc:2379] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e50e33cc894496ca8e566d8db26ddb6 in current term 1: Already voted for candidate d8140523412b4097bfd606b5ab5112ca in this term.
I20260812 01:18:09.695067 22156 raft_consensus.cc:2454] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8140523412b4097bfd606b5ab5112ca in term 1.
I20260812 01:18:09.695084 21788 leader_election.cc:302] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e50e33cc894496ca8e566d8db26ddb6, d8140523412b4097bfd606b5ab5112ca; no voters:
I20260812 01:18:09.695142 22154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c5214ceddf46e3968654457dc1b29a" candidate_uuid: "1e50e33cc894496ca8e566d8db26ddb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" is_pre_election: true
I20260812 01:18:09.695257 22154 raft_consensus.cc:2379] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e50e33cc894496ca8e566d8db26ddb6 in current term 1: Already voted for candidate d8140523412b4097bfd606b5ab5112ca in this term.
I20260812 01:18:09.695391 22562 raft_consensus.cc:2781] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:09.695497 22291 leader_election.cc:302] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e50e33cc894496ca8e566d8db26ddb6; no voters: bdbeddeca98c4d5ea3aca3a737d21ca0, d8140523412b4097bfd606b5ab5112ca
I20260812 01:18:09.695612 22562 raft_consensus.cc:686] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 1 LEADER]: Becoming Leader. State: Replica: d8140523412b4097bfd606b5ab5112ca, State: Running, Role: LEADER
I20260812 01:18:09.695621 22561 raft_consensus.cc:2726] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 01:18:09.695745 22562 consensus_queue.cc:237] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 } } peers { permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 } } peers { permanent_uuid: "d8140523412b4097bfd606b5ab5112ca" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38373 } }
I20260812 01:18:09.696664 21663 catalog_manager.cc:5495] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca reported cstate change: term changed from 0 to 1, leader changed from <none> to d8140523412b4097bfd606b5ab5112ca (127.17.183.129). New cstate: current_term: 1 leader_uuid: "d8140523412b4097bfd606b5ab5112ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8140523412b4097bfd606b5ab5112ca" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260812 01:18:09.702711 22542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.700689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36568 (local address 127.17.183.129:38373)
0812 01:18:09.700753 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.700754 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.700762 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:18:09.700815 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.700816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.700830 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.700892 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:09.700994 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.701413 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.702074 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.702237 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.702285 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.702410 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:09.702498 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:09.702555 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.702590 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.702604 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 01:18:09.704281 22154 raft_consensus.cc:1261] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0 [term 1 FOLLOWER]: Refusing update from remote peer d8140523412b4097bfd606b5ab5112ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:09.704346 22415 raft_consensus.cc:1261] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 1 FOLLOWER]: Refusing update from remote peer d8140523412b4097bfd606b5ab5112ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:09.704633 22567 consensus_queue.cc:1035] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbeddeca98c4d5ea3aca3a737d21ca0" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 39023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:09.704773 22562 consensus_queue.cc:1035] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e50e33cc894496ca8e566d8db26ddb6" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 37289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:09.707144 22575 mvcc.cc:205] Tried to move back new op lower bound from 7317493717826539520 to 7317493717794426880. Current Snapshot: MvccSnapshot[applied={T|T < 7317493717826539520}]
I20260812 01:18:09.708127 22580 mvcc.cc:205] Tried to move back new op lower bound from 7317493717826539520 to 7317493717794426880. Current Snapshot: MvccSnapshot[applied={T|T < 7317493717826539520}]
I20260812 01:18:09.709883 22581 mvcc.cc:205] Tried to move back new op lower bound from 7317493717826539520 to 7317493717794426880. Current Snapshot: MvccSnapshot[applied={T|T < 7317493717826539520}]
I20260812 01:18:09.711112 21663 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:09.711210 21663 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:09.712729 21663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 497d6d77945341adaf41f75136b6acbe: Sending DeleteTablet for 3 replicas of tablet a6c5214ceddf46e3968654457dc1b29a
I20260812 01:18:09.713107 22115 tablet_service.cc:1514] Processing DeleteTablet for tablet a6c5214ceddf46e3968654457dc1b29a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:09 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:43618
I20260812 01:18:09.713256 21877 tablet_service.cc:1514] Processing DeleteTablet for tablet a6c5214ceddf46e3968654457dc1b29a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:09 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:36566
I20260812 01:18:09.713385 22597 tablet_replica.cc:330] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: stopping tablet replica
I20260812 01:18:09.713496 22597 raft_consensus.cc:2229] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:18:09.713493 22599 tablet_replica.cc:330] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca: stopping tablet replica
I20260812 01:18:09.713584 22599 raft_consensus.cc:2229] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:18:09.713598 22597 raft_consensus.cc:2258] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:09.713604 22381 tablet_service.cc:1514] Processing DeleteTablet for tablet a6c5214ceddf46e3968654457dc1b29a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:09 UTC) from {username='kudu', principal='kudu/127.17.183.190@KRBTEST.COM'} at 127.0.0.1:50562
I20260812 01:18:09.713675 22599 raft_consensus.cc:2258] T a6c5214ceddf46e3968654457dc1b29a P d8140523412b4097bfd606b5ab5112ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:09.713918 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 21758
I20260812 01:18:09.721457 22597 ts_tablet_manager.cc:1905] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:09.723697 22597 ts_tablet_manager.cc:1918] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:09.723867 22597 log.cc:1196] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/a6c5214ceddf46e3968654457dc1b29a
I20260812 01:18:09.724175 22597 ts_tablet_manager.cc:1939] T a6c5214ceddf46e3968654457dc1b29a P bdbeddeca98c4d5ea3aca3a737d21ca0: Deleting consensus metadata
I20260812 01:18:09.726778 21642 catalog_manager.cc:4841] TS bdbeddeca98c4d5ea3aca3a737d21ca0 (127.17.183.130:39023): tablet a6c5214ceddf46e3968654457dc1b29a (table test-table [id=b75bd4e55e034f8db7a6d3d7a6761fdd]) successfully deleted
I20260812 01:18:09.727268 22601 tablet_replica.cc:330] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6: stopping tablet replica
I20260812 01:18:09.727411 22601 raft_consensus.cc:2229] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:18:09.727540 22601 raft_consensus.cc:2258] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:09.728006 22601 ts_tablet_manager.cc:1905] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:09.730085 22601 ts_tablet_manager.cc:1918] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:09.730176 22601 log.cc:1196] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/a6c5214ceddf46e3968654457dc1b29a
I20260812 01:18:09.730486 22601 ts_tablet_manager.cc:1939] T a6c5214ceddf46e3968654457dc1b29a P 1e50e33cc894496ca8e566d8db26ddb6: Deleting consensus metadata
I20260812 01:18:09.730986 21641 catalog_manager.cc:4841] TS 1e50e33cc894496ca8e566d8db26ddb6 (127.17.183.131:37289): tablet a6c5214ceddf46e3968654457dc1b29a (table test-table [id=b75bd4e55e034f8db7a6d3d7a6761fdd]) successfully deleted
W20260812 01:18:09.733007 21641 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:38373 (error 108)
I20260812 01:18:09.733318 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 21994
I20260812 01:18:09.736730 22540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.733436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:38373 (local address 127.0.0.1:36570)
0812 01:18:09.736654 (+ 3218us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:09.736703 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:38373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3195}
W20260812 01:18:09.757453 21641 catalog_manager.cc:4584] TS d8140523412b4097bfd606b5ab5112ca (127.17.183.129:38373): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a6c5214ceddf46e3968654457dc1b29a: Network error: Client connection negotiation failed: client connection to 127.17.183.129:38373: connect: Connection refused (error 111)
I20260812 01:18:09.762171 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 22258
I20260812 01:18:09.772758 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 21615
2026-08-12T01:18:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2265 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T01:18:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:09Z Disabled control of system clock
I20260812 01:18:09.814131 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43551
--webserver_interface=127.17.183.190
--webserver_port=0
--builtin_ntp_servers=127.17.183.148:34937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:43551
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:18:09.897074 22612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:09.897301 22612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:09.897321 22612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:09.898401 22612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:09.898437 22612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:09.898450 22612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:09.898463 22612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:09.898474 22612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:09.899820 22612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:34937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:43551
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:43551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:09.900018 22612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:09.900269 22612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:09.905105 22625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:09.905128 22628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:09.905234 22612 server_base.cc:1034] running on GCE node
W20260812 01:18:09.905417 22626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:09.905720 22612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:09.906036 22612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:09.907183 22612 hybrid_clock.cc:648] HybridClock initialized: now 1786497489907158 us; error 39 us; skew 500 ppm
I20260812 01:18:09.908613 22612 webserver.cc:460] Webserver started at http://127.17.183.190:43445/ using document root <none> and password file <none>
I20260812 01:18:09.908895 22612 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:09.908947 22612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:09.909082 22612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:09.910164 22612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "324578e5d1e44b6f91ec5d3d64691f08"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "935361cc762e754a58986c62c02d08cc"
server_key_iv: "8ff1767135393fef36cd7cf9e91c22f4"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.910548 22612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "324578e5d1e44b6f91ec5d3d64691f08"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "935361cc762e754a58986c62c02d08cc"
server_key_iv: "8ff1767135393fef36cd7cf9e91c22f4"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.911878 22612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:18:09.912712 22638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:09.912915 22612 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:18:09.913008 22612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "324578e5d1e44b6f91ec5d3d64691f08"
format_stamp: "Formatted at 2026-08-12 01:18:09 on dist-test-slave-rwrg"
server_key: "935361cc762e754a58986c62c02d08cc"
server_key_iv: "8ff1767135393fef36cd7cf9e91c22f4"
server_key_version: "encryptionkey@0"
I20260812 01:18:09.913094 22612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:09.924914 22612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:09.925227 22612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:09.925390 22612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:09.929592 22612 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:43551
I20260812 01:18:09.929632 22730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:43551 every 8 connection(s)
I20260812 01:18:09.929991 22612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:09.930964 22731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:09.933363 22731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08: Bootstrap starting.
I20260812 01:18:09.933902 22731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:09.934160 22731 log.cc:824] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:09.934805 22731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08: No bootstrap required, opened a new log
I20260812 01:18:09.936411 22731 raft_consensus.cc:348] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324578e5d1e44b6f91ec5d3d64691f08" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43551 } }
I20260812 01:18:09.936618 22731 raft_consensus.cc:374] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:09.936650 22731 raft_consensus.cc:729] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 324578e5d1e44b6f91ec5d3d64691f08, State: Initialized, Role: FOLLOWER
I20260812 01:18:09.936764 22731 consensus_queue.cc:260] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324578e5d1e44b6f91ec5d3d64691f08" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43551 } }
I20260812 01:18:09.936818 22731 raft_consensus.cc:388] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:09.936839 22731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:09.936865 22731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:09.937347 22731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324578e5d1e44b6f91ec5d3d64691f08" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43551 } }
I20260812 01:18:09.937434 22731 leader_election.cc:302] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 324578e5d1e44b6f91ec5d3d64691f08; no voters:
I20260812 01:18:09.937573 22731 leader_election.cc:288] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:09.937649 22734 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:09.937831 22734 raft_consensus.cc:686] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [term 1 LEADER]: Becoming Leader. State: Replica: 324578e5d1e44b6f91ec5d3d64691f08, State: Running, Role: LEADER
I20260812 01:18:09.937839 22731 sys_catalog.cc:564] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:09.937963 22734 consensus_queue.cc:237] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324578e5d1e44b6f91ec5d3d64691f08" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43551 } }
I20260812 01:18:09.938648 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 22612
I20260812 01:18:09.938746 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:09.938958 18142 external_mini_cluster.cc:1428] Setting key b9794be65c045f6072b24648ea0722e6
I20260812 01:18:09.938475 22737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "324578e5d1e44b6f91ec5d3d64691f08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324578e5d1e44b6f91ec5d3d64691f08" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43551 } } }
I20260812 01:18:09.938383 22739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 324578e5d1e44b6f91ec5d3d64691f08. Latest consensus state: current_term: 1 leader_uuid: "324578e5d1e44b6f91ec5d3d64691f08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324578e5d1e44b6f91ec5d3d64691f08" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 43551 } } }
I20260812 01:18:09.939915 22737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:09.939931 22739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08 [sys.catalog]: This master's current role is: LEADER
W20260812 01:18:09.940276 22759 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:18:09.940343 22759 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:18:09.940539 22769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:09.940747 22769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:09.942438 22769 catalog_manager.cc:1347] Generated new cluster ID: 4dc315b3930d4abf98da7b104834b456
I20260812 01:18:09.942507 22769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:09.945442 22765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:09.939563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54834 (local address 127.17.183.190:43551)
0812 01:18:09.939814 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:09.939824 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:09.939867 (+ 43us) server_negotiation.cc:407] Connection header received
0812 01:18:09.940308 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:09.940316 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:09.940389 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:09.940577 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:09.940895 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.942073 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.943241 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:09.943850 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:09.943967 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:09.944737 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:09.944741 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:09.944741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:09.944947 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:09.944987 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:09.945001 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:09.945074 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:09.945171 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 01:18:09.945242 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":76,"threads_started":1}
I20260812 01:18:09.961814 22769 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:09.962338 22769 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:09.967614 22769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08: Generated new TSK 0
I20260812 01:18:09.967803 22769 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:09.973722 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.129:0
--local_ip_for_outbound_sockets=127.17.183.129
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43551
--builtin_ntp_servers=127.17.183.148:34937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:18:10.059597 22771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:10.059809 22771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:10.059830 22771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:10.061026 22771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:10.061074 22771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:10.061105 22771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.129
I20260812 01:18:10.062479 22771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:34937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.183.129
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.129
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:10.062736 22771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:10.063038 22771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:10.068403 22782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:10.068409 22789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:10.068451 22779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:10.068409 22771 server_base.cc:1034] running on GCE node
I20260812 01:18:10.068904 22771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:10.069204 22771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:10.070398 22771 hybrid_clock.cc:648] HybridClock initialized: now 1786497490070403 us; error 48 us; skew 500 ppm
I20260812 01:18:10.071710 22771 webserver.cc:460] Webserver started at http://127.17.183.129:42263/ using document root <none> and password file <none>
I20260812 01:18:10.071978 22771 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:10.072063 22771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:10.072223 22771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:10.073426 22771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/data/instance:
uuid: "d880c49387bb46fe9fd8a0b0a7759bf5"
format_stamp: "Formatted at 2026-08-12 01:18:10 on dist-test-slave-rwrg"
server_key: "9c60b34988ce03b370381305e7683eb4"
server_key_iv: "4312349ada03f5887ea7f9dcf6ae8745"
server_key_version: "encryptionkey@0"
I20260812 01:18:10.073879 22771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance:
uuid: "d880c49387bb46fe9fd8a0b0a7759bf5"
format_stamp: "Formatted at 2026-08-12 01:18:10 on dist-test-slave-rwrg"
server_key: "9c60b34988ce03b370381305e7683eb4"
server_key_iv: "4312349ada03f5887ea7f9dcf6ae8745"
server_key_version: "encryptionkey@0"
I20260812 01:18:10.075232 22771 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 01:18:10.075951 22797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:10.076125 22771 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:18:10.076243 22771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/wal
uuid: "d880c49387bb46fe9fd8a0b0a7759bf5"
format_stamp: "Formatted at 2026-08-12 01:18:10 on dist-test-slave-rwrg"
server_key: "9c60b34988ce03b370381305e7683eb4"
server_key_iv: "4312349ada03f5887ea7f9dcf6ae8745"
server_key_version: "encryptionkey@0"
I20260812 01:18:10.076326 22771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:10.090484 22771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:10.090798 22771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:10.090955 22771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:10.091190 22771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:10.091531 22771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:10.091586 22771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:10.091629 22771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:10.091656 22771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:10.097483 22771 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.129:39517
I20260812 01:18:10.097563 22987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.129:39517 every 8 connection(s)
I20260812 01:18:10.097927 22771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/data/info.pb
I20260812 01:18:10.099617 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 22771
I20260812 01:18:10.099748 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-0/wal/instance
I20260812 01:18:10.099956 18142 external_mini_cluster.cc:1428] Setting key b64a9963a2e429995a12392fcd42149e
I20260812 01:18:10.100968 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.130:0
--local_ip_for_outbound_sockets=127.17.183.130
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43551
--builtin_ntp_servers=127.17.183.148:34937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 01:18:10.103578 22765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.098686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:59979 (local address 127.17.183.190:43551)
0812 01:18:10.098740 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:10.098742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:10.098977 (+ 235us) server_negotiation.cc:407] Connection header received
0812 01:18:10.099513 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:10.099515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:10.099538 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:10.099591 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:10.100473 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.101092 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.102108 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.102335 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.102411 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.103300 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:10.103301 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:10.103302 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:10.103306 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:10.103321 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:10.103326 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:10.103377 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:10.103461 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 01:18:10.103491 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:18:10.103778 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.098615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43551 (local address 127.17.183.129:59979)
0812 01:18:10.098849 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:10.098882 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:10.099403 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:10.099677 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:10.099681 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:10.099691 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:10.100354 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.100362 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.101190 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.101192 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.102003 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.102006 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.102423 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.102424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.102567 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.103158 (+ 591us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:18:10.103159 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:10.103188 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:18:10.103209 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:10.103387 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:10.103392 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:10.103396 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:10.103455 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 01:18:10.103554 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":100,"threads_started":1}
I20260812 01:18:10.104318 22991 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43551
I20260812 01:18:10.104409 22991 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:10.104628 22991 heartbeater.cc:511] Master 127.17.183.190:43551 requested a full tablet report, sending...
I20260812 01:18:10.105181 22669 ts_manager.cc:194] Registered new tserver with Master: d880c49387bb46fe9fd8a0b0a7759bf5 (127.17.183.129:39517)
I20260812 01:18:10.106196 22669 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.129:59979
W20260812 01:18:10.185796 22994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:10.185994 22994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:10.186017 22994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:10.187069 22994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:10.187129 22994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:10.187157 22994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.130
I20260812 01:18:10.188413 22994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:34937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.183.130
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.130
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:10.188651 22994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:10.188892 22994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:10.193778 23000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:10.193923 22994 server_base.cc:1034] running on GCE node
W20260812 01:18:10.193785 23004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:10.193804 23001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:10.194212 22994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:10.194406 22994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:10.195540 22994 hybrid_clock.cc:648] HybridClock initialized: now 1786497490195529 us; error 28 us; skew 500 ppm
I20260812 01:18:10.196874 22994 webserver.cc:460] Webserver started at http://127.17.183.130:37601/ using document root <none> and password file <none>
I20260812 01:18:10.197135 22994 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:10.197206 22994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:10.197362 22994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:10.198427 22994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/data/instance:
uuid: "0aa91b683efc435e9c0417964ad84b6f"
format_stamp: "Formatted at 2026-08-12 01:18:10 on dist-test-slave-rwrg"
server_key: "fefec17d75d86f8ebefca5fc28937988"
server_key_iv: "6672b511ffcbfc75ab6ae5b0c298ad77"
server_key_version: "encryptionkey@0"
I20260812 01:18:10.198778 22994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance:
uuid: "0aa91b683efc435e9c0417964ad84b6f"
format_stamp: "Formatted at 2026-08-12 01:18:10 on dist-test-slave-rwrg"
server_key: "fefec17d75d86f8ebefca5fc28937988"
server_key_iv: "6672b511ffcbfc75ab6ae5b0c298ad77"
server_key_version: "encryptionkey@0"
I20260812 01:18:10.200048 22994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:10.200763 23013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:10.200917 22994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:10.201010 22994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/wal
uuid: "0aa91b683efc435e9c0417964ad84b6f"
format_stamp: "Formatted at 2026-08-12 01:18:10 on dist-test-slave-rwrg"
server_key: "fefec17d75d86f8ebefca5fc28937988"
server_key_iv: "6672b511ffcbfc75ab6ae5b0c298ad77"
server_key_version: "encryptionkey@0"
I20260812 01:18:10.201093 22994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:10.223387 22994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:10.223709 22994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:10.223865 22994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:10.224118 22994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:10.224445 22994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:10.224499 22994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:10.224574 22994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:10.224596 22994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:10.230536 22994 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.130:32955
I20260812 01:18:10.230594 23229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.130:32955 every 8 connection(s)
I20260812 01:18:10.230891 22994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/data/info.pb
I20260812 01:18:10.235895 22765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.231603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.130:41743 (local address 127.17.183.190:43551)
0812 01:18:10.231675 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:10.231678 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:10.231948 (+ 270us) server_negotiation.cc:407] Connection header received
0812 01:18:10.232434 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:10.232435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:10.232445 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:10.232569 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:10.233250 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.233739 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.234659 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.234840 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.234889 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.235652 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:10.235653 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:10.235653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:10.235657 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:10.235672 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:10.235676 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:10.235719 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:10.235812 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 01:18:10.235837 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 01:18:10.236066 23235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.231593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43551 (local address 127.17.183.130:41743)
0812 01:18:10.231825 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:10.231859 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:10.232344 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:10.232645 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:10.232648 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:10.232656 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:10.233162 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.233166 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.233825 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.233826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.234583 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.234584 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.234918 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.234919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.235031 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.235519 (+ 488us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:18:10.235519 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:10.235547 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:18:10.235568 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:10.235732 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:10.235743 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:10.235745 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:18:10.235796 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 01:18:10.235873 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":109,"threads_started":1}
I20260812 01:18:10.236654 23230 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43551
I20260812 01:18:10.236763 23230 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:10.236937 23230 heartbeater.cc:511] Master 127.17.183.190:43551 requested a full tablet report, sending...
I20260812 01:18:10.237342 22669 ts_manager.cc:194] Registered new tserver with Master: 0aa91b683efc435e9c0417964ad84b6f (127.17.183.130:32955)
I20260812 01:18:10.237504 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 22994
I20260812 01:18:10.237614 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/wal/instance
I20260812 01:18:10.237787 22669 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.130:41743
I20260812 01:18:10.237854 18142 external_mini_cluster.cc:1428] Setting key d4d4eb575ff245a494d68fd602b953a2
I20260812 01:18:10.238864 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.183.131:0
--local_ip_for_outbound_sockets=127.17.183.131
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43551
--builtin_ntp_servers=127.17.183.148:34937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:18:10.322767 23237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:10.322958 23237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:10.322979 23237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:10.324045 23237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:10.324080 23237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:10.324105 23237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.183.131
I20260812 01:18:10.325423 23237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:34937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.183.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.183.131
--webserver_port=0
--tserver_master_addrs=127.17.183.190:43551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.183.131
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:10.325608 23237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:10.325840 23237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:10.331010 23247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:10.331002 23246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:10.331003 23249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:10.331219 23237 server_base.cc:1034] running on GCE node
I20260812 01:18:10.331486 23237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:10.331732 23237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:10.332898 23237 hybrid_clock.cc:648] HybridClock initialized: now 1786497490332882 us; error 50 us; skew 500 ppm
I20260812 01:18:10.334173 23237 webserver.cc:460] Webserver started at http://127.17.183.131:38147/ using document root <none> and password file <none>
I20260812 01:18:10.334408 23237 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:10.334477 23237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:10.334637 23237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:10.335724 23237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/data/instance:
uuid: "fa45e76bfdab48ceae1a050180f3ac31"
format_stamp: "Formatted at 2026-08-12 01:18:10 on dist-test-slave-rwrg"
server_key: "d97b5c49cc405f06a184a9868478292b"
server_key_iv: "0d4458bc7f56929c9cd0e0dadb46389f"
server_key_version: "encryptionkey@0"
I20260812 01:18:10.336091 23237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance:
uuid: "fa45e76bfdab48ceae1a050180f3ac31"
format_stamp: "Formatted at 2026-08-12 01:18:10 on dist-test-slave-rwrg"
server_key: "d97b5c49cc405f06a184a9868478292b"
server_key_iv: "0d4458bc7f56929c9cd0e0dadb46389f"
server_key_version: "encryptionkey@0"
I20260812 01:18:10.337600 23237 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:10.338367 23257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:10.338570 23237 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:18:10.338701 23237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/wal
uuid: "fa45e76bfdab48ceae1a050180f3ac31"
format_stamp: "Formatted at 2026-08-12 01:18:10 on dist-test-slave-rwrg"
server_key: "d97b5c49cc405f06a184a9868478292b"
server_key_iv: "0d4458bc7f56929c9cd0e0dadb46389f"
server_key_version: "encryptionkey@0"
I20260812 01:18:10.338778 23237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:10.358125 23237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:10.358456 23237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:10.358618 23237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:10.358844 23237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:18:10.359200 23237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:18:10.359254 23237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:10.359287 23237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:18:10.359314 23237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:10.365072 23237 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.131:33813
I20260812 01:18:10.365142 23483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.131:33813 every 8 connection(s)
I20260812 01:18:10.365450 23237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/data/info.pb
I20260812 01:18:10.370814 22765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.366281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.131:37765 (local address 127.17.183.190:43551)
0812 01:18:10.366356 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:10.366359 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:10.366613 (+ 254us) server_negotiation.cc:407] Connection header received
0812 01:18:10.367158 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:10.367159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:10.367172 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:10.367229 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:10.367911 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.368400 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.369404 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.369614 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.369702 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.370506 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:10.370507 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:10.370508 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:10.370512 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:10.370527 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:10.370532 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:10.370611 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:10.370704 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 01:18:10.370736 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 01:18:10.371042 23490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.366234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:43551 (local address 127.17.183.131:37765)
0812 01:18:10.366469 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:10.366504 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:10.367042 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:10.367297 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:10.367300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:10.367312 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:10.367815 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.367820 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.368519 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.368520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.369306 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.369308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.369714 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.369715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.369846 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.370352 (+ 506us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:18:10.370352 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:10.370381 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:18:10.370402 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:10.370615 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:10.370622 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:10.370625 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:18:10.370706 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 01:18:10.370802 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":107,"threads_started":1}
I20260812 01:18:10.371569 23484 heartbeater.cc:347] Connected to a master server at 127.17.183.190:43551
I20260812 01:18:10.371693 23484 heartbeater.cc:464] Registering TS with master...
I20260812 01:18:10.371878 23484 heartbeater.cc:511] Master 127.17.183.190:43551 requested a full tablet report, sending...
I20260812 01:18:10.372260 22669 ts_manager.cc:194] Registered new tserver with Master: fa45e76bfdab48ceae1a050180f3ac31 (127.17.183.131:33813)
I20260812 01:18:10.372644 22669 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.183.131:37765
I20260812 01:18:10.374536 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 23237
I20260812 01:18:10.374634 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/wal/instance
I20260812 01:18:10.374788 18142 external_mini_cluster.cc:1428] Setting key f3517663e66a752c8bae83acae520301
I20260812 01:18:10.375577 18142 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:18:10.379703 22765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.376982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54848 (local address 127.17.183.190:43551)
0812 01:18:10.377023 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:10.377024 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:10.377150 (+ 126us) server_negotiation.cc:407] Connection header received
0812 01:18:10.377194 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:10.377195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:10.377204 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:10.377251 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:10.377414 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.377845 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.378607 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.378775 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.378826 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.379487 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:10.379488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:10.379489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:10.379493 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:10.379507 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:10.379514 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:10.379555 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:10.379634 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 01:18:10.379653 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 01:18:10.381343 22669 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54848:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:18:10.382928 22669 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:18:10.389763 23506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.385354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:33813 (local address 127.0.0.1:56742)
0812 01:18:10.385778 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:10.385788 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:10.385873 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:10.386115 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:10.386116 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:10.386117 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:10.386153 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.386155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.387513 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.387514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.388433 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.388435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.389423 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.389425 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.389523 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.389539 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 01:18:10.389622 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 01:18:10.389674 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":75,"thread_start_us":95,"threads_started":1}
I20260812 01:18:10.389786 23503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.385430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56742 (local address 127.17.183.131:33813)
0812 01:18:10.385609 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:10.385614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:10.385843 (+ 229us) server_negotiation.cc:407] Connection header received
0812 01:18:10.385963 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:10.385966 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:10.385981 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:10.386033 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:10.386233 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.387406 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.388565 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.389318 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.389397 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.389478 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:10.389654 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 01:18:10.389696 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
I20260812 01:18:10.390270 23502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.385347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:39517 (local address 127.0.0.1:34404)
0812 01:18:10.385505 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:10.385550 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:10.385620 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:10.386022 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:10.386025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:10.386028 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:10.386099 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.386102 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.387503 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.387504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.388923 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.388926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.390038 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.390039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.390111 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.390115 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:10.390149 (+ 34us) client_negotiation.cc:240] Negotiation successful
0812 01:18:10.390194 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":45,"thread_start_us":69,"threads_started":1}
I20260812 01:18:10.390383 23500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.385625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:32955 (local address 127.0.0.1:60434)
0812 01:18:10.385845 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:10.385858 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:10.385916 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:10.386388 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:10.386389 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:10.386391 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:10.386457 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.386459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.387436 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.387437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.389038 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.389040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.390062 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.390064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.390136 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.390140 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:18:10.390198 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 01:18:10.390265 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":80,"thread_start_us":86,"threads_started":1}
I20260812 01:18:10.390705 23508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.385630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34404 (local address 127.17.183.129:39517)
0812 01:18:10.385832 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:10.385837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:10.385847 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:18:10.385890 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:10.385892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:10.385909 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:10.386178 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:10.386274 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.387425 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.389012 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.389785 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.390488 (+ 703us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.390590 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:10.390614 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 01:18:10.390645 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":92,"threads_started":1}
I20260812 01:18:10.390760 23509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.385870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60434 (local address 127.17.183.130:32955)
0812 01:18:10.386177 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:10.386182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:10.386193 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:18:10.386244 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:10.386246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:10.386277 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:10.386387 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:10.386570 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.387329 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.389127 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.389949 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.390485 (+ 536us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.390592 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:10.390622 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 01:18:10.390663 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":111,"threads_started":1}
I20260812 01:18:10.390714 23352 tablet_service.cc:1467] Processing CreateTablet for tablet eb89b2eee31f49cf9ad55bba95a6ac47 (DEFAULT_TABLE table=test-table [id=a35045d909274740b4322ed5602c45b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:10.391156 23352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb89b2eee31f49cf9ad55bba95a6ac47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:10.393136 22877 tablet_service.cc:1467] Processing CreateTablet for tablet eb89b2eee31f49cf9ad55bba95a6ac47 (DEFAULT_TABLE table=test-table [id=a35045d909274740b4322ed5602c45b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:10.393256 23102 tablet_service.cc:1467] Processing CreateTablet for tablet eb89b2eee31f49cf9ad55bba95a6ac47 (DEFAULT_TABLE table=test-table [id=a35045d909274740b4322ed5602c45b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:18:10.393492 22877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb89b2eee31f49cf9ad55bba95a6ac47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:10.393653 23102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb89b2eee31f49cf9ad55bba95a6ac47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:10.394750 23513 tablet_bootstrap.cc:492] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31: Bootstrap starting.
I20260812 01:18:10.395484 23513 tablet_bootstrap.cc:654] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:10.395831 23513 log.cc:824] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:10.396718 23513 tablet_bootstrap.cc:492] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31: No bootstrap required, opened a new log
I20260812 01:18:10.396797 23513 ts_tablet_manager.cc:1397] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 01:18:10.397341 23520 tablet_bootstrap.cc:492] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f: Bootstrap starting.
I20260812 01:18:10.397923 23520 tablet_bootstrap.cc:654] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:10.398252 23520 log.cc:824] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:10.398958 23520 tablet_bootstrap.cc:492] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f: No bootstrap required, opened a new log
I20260812 01:18:10.399051 23520 ts_tablet_manager.cc:1397] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:18:10.398974 23513 raft_consensus.cc:348] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa45e76bfdab48ceae1a050180f3ac31" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33813 } } peers { permanent_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39517 } } peers { permanent_uuid: "0aa91b683efc435e9c0417964ad84b6f" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 32955 } }
I20260812 01:18:10.399144 23513 raft_consensus.cc:374] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:10.399185 23513 raft_consensus.cc:729] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa45e76bfdab48ceae1a050180f3ac31, State: Initialized, Role: FOLLOWER
I20260812 01:18:10.399308 23513 consensus_queue.cc:260] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa45e76bfdab48ceae1a050180f3ac31" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33813 } } peers { permanent_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39517 } } peers { permanent_uuid: "0aa91b683efc435e9c0417964ad84b6f" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 32955 } }
I20260812 01:18:10.399585 23513 ts_tablet_manager.cc:1428] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:18:10.399664 23484 heartbeater.cc:503] Master 127.17.183.190:43551 was elected leader, sending a full tablet report...
I20260812 01:18:10.399803 23519 tablet_bootstrap.cc:492] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5: Bootstrap starting.
I20260812 01:18:10.400475 23519 tablet_bootstrap.cc:654] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:10.400882 23519 log.cc:824] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:10.401525 23520 raft_consensus.cc:348] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa45e76bfdab48ceae1a050180f3ac31" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33813 } } peers { permanent_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39517 } } peers { permanent_uuid: "0aa91b683efc435e9c0417964ad84b6f" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 32955 } }
I20260812 01:18:10.401690 23520 raft_consensus.cc:374] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:10.401713 23519 tablet_bootstrap.cc:492] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5: No bootstrap required, opened a new log
I20260812 01:18:10.401742 23520 raft_consensus.cc:729] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa91b683efc435e9c0417964ad84b6f, State: Initialized, Role: FOLLOWER
I20260812 01:18:10.401772 23519 ts_tablet_manager.cc:1397] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 01:18:10.401865 23520 consensus_queue.cc:260] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa45e76bfdab48ceae1a050180f3ac31" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33813 } } peers { permanent_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39517 } } peers { permanent_uuid: "0aa91b683efc435e9c0417964ad84b6f" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 32955 } }
I20260812 01:18:10.402140 23520 ts_tablet_manager.cc:1428] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 01:18:10.402195 23230 heartbeater.cc:503] Master 127.17.183.190:43551 was elected leader, sending a full tablet report...
I20260812 01:18:10.404062 23519 raft_consensus.cc:348] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa45e76bfdab48ceae1a050180f3ac31" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33813 } } peers { permanent_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39517 } } peers { permanent_uuid: "0aa91b683efc435e9c0417964ad84b6f" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 32955 } }
I20260812 01:18:10.404192 23519 raft_consensus.cc:374] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:10.404261 23519 raft_consensus.cc:729] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d880c49387bb46fe9fd8a0b0a7759bf5, State: Initialized, Role: FOLLOWER
I20260812 01:18:10.404376 23519 consensus_queue.cc:260] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa45e76bfdab48ceae1a050180f3ac31" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33813 } } peers { permanent_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39517 } } peers { permanent_uuid: "0aa91b683efc435e9c0417964ad84b6f" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 32955 } }
I20260812 01:18:10.404670 23519 ts_tablet_manager.cc:1428] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:18:10.404807 22991 heartbeater.cc:503] Master 127.17.183.190:43551 was elected leader, sending a full tablet report...
I20260812 01:18:10.426697 23531 raft_consensus.cc:482] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:18:10.426827 23531 raft_consensus.cc:504] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa45e76bfdab48ceae1a050180f3ac31" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33813 } } peers { permanent_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39517 } } peers { permanent_uuid: "0aa91b683efc435e9c0417964ad84b6f" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 32955 } }
I20260812 01:18:10.427188 23531 leader_election.cc:288] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa45e76bfdab48ceae1a050180f3ac31 (127.17.183.131:33813), 0aa91b683efc435e9c0417964ad84b6f (127.17.183.130:32955)
I20260812 01:18:10.431198 23503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.427440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:48449 (local address 127.17.183.131:33813)
0812 01:18:10.427485 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:10.427487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:10.427496 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:18:10.427526 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:10.427527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:10.427536 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:10.427597 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:10.427821 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.428667 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.430198 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.430761 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.430856 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.430863 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:10.431063 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 01:18:10.431129 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 01:18:10.431198 23509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.427413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.183.129:53333 (local address 127.17.183.130:32955)
0812 01:18:10.427462 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:10.427464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:10.427616 (+ 152us) server_negotiation.cc:407] Connection header received
0812 01:18:10.427683 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:10.427684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:10.427692 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:10.427735 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:18:10.427897 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.428668 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.430198 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.430789 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.430853 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.430862 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:10.431063 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 01:18:10.431129 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 01:18:10.431284 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.427335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.131:33813 (local address 127.17.183.129:48449)
0812 01:18:10.427391 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:10.427404 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:10.427448 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:10.427621 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:10.427622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:10.427624 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:10.427702 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.427709 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.428760 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.428760 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.430079 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.430083 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.430894 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.430896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.430973 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.430976 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 01:18:10.431031 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 01:18:10.431203 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":54}
I20260812 01:18:10.431298 23533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.427374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.130:32955 (local address 127.17.183.129:53333)
0812 01:18:10.427528 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:10.427538 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:10.427620 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:10.427762 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:10.427763 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:10.427764 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:18:10.427828 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.427830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.428755 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.428756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.430083 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:10.430084 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.430901 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.430902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:10.430979 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.430981 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 01:18:10.431031 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 01:18:10.431080 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":77,"thread_start_us":99,"threads_started":1}
I20260812 01:18:10.431690 23396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb89b2eee31f49cf9ad55bba95a6ac47" candidate_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa45e76bfdab48ceae1a050180f3ac31" is_pre_election: true
I20260812 01:18:10.431713 23136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb89b2eee31f49cf9ad55bba95a6ac47" candidate_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa91b683efc435e9c0417964ad84b6f" is_pre_election: true
I20260812 01:18:10.431845 23136 raft_consensus.cc:2454] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d880c49387bb46fe9fd8a0b0a7759bf5 in term 0.
I20260812 01:18:10.431845 23396 raft_consensus.cc:2454] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d880c49387bb46fe9fd8a0b0a7759bf5 in term 0.
I20260812 01:18:10.432092 22805 leader_election.cc:302] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d880c49387bb46fe9fd8a0b0a7759bf5, fa45e76bfdab48ceae1a050180f3ac31; no voters:
I20260812 01:18:10.432281 23531 raft_consensus.cc:2781] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:18:10.432385 23531 raft_consensus.cc:482] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:18:10.432417 23531 raft_consensus.cc:3037] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:10.433175 23531 raft_consensus.cc:504] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa45e76bfdab48ceae1a050180f3ac31" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33813 } } peers { permanent_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39517 } } peers { permanent_uuid: "0aa91b683efc435e9c0417964ad84b6f" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 32955 } }
I20260812 01:18:10.433326 23531 leader_election.cc:288] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [CANDIDATE]: Term 1 election: Requested vote from peers fa45e76bfdab48ceae1a050180f3ac31 (127.17.183.131:33813), 0aa91b683efc435e9c0417964ad84b6f (127.17.183.130:32955)
I20260812 01:18:10.433540 23396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb89b2eee31f49cf9ad55bba95a6ac47" candidate_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa45e76bfdab48ceae1a050180f3ac31"
I20260812 01:18:10.433593 23136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb89b2eee31f49cf9ad55bba95a6ac47" candidate_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa91b683efc435e9c0417964ad84b6f"
I20260812 01:18:10.433646 23396 raft_consensus.cc:3037] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:10.433688 23136 raft_consensus.cc:3037] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:10.434427 23396 raft_consensus.cc:2454] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d880c49387bb46fe9fd8a0b0a7759bf5 in term 1.
I20260812 01:18:10.434507 23136 raft_consensus.cc:2454] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d880c49387bb46fe9fd8a0b0a7759bf5 in term 1.
I20260812 01:18:10.434646 22805 leader_election.cc:302] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d880c49387bb46fe9fd8a0b0a7759bf5, fa45e76bfdab48ceae1a050180f3ac31; no voters:
I20260812 01:18:10.434724 23531 raft_consensus.cc:2781] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:10.434854 23531 raft_consensus.cc:686] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [term 1 LEADER]: Becoming Leader. State: Replica: d880c49387bb46fe9fd8a0b0a7759bf5, State: Running, Role: LEADER
I20260812 01:18:10.434978 23531 consensus_queue.cc:237] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa45e76bfdab48ceae1a050180f3ac31" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33813 } } peers { permanent_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39517 } } peers { permanent_uuid: "0aa91b683efc435e9c0417964ad84b6f" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 32955 } }
I20260812 01:18:10.435823 22669 catalog_manager.cc:5495] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d880c49387bb46fe9fd8a0b0a7759bf5 (127.17.183.129). New cstate: current_term: 1 leader_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa45e76bfdab48ceae1a050180f3ac31" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d880c49387bb46fe9fd8a0b0a7759bf5" member_type: VOTER last_known_addr { host: "127.17.183.129" port: 39517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aa91b683efc435e9c0417964ad84b6f" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 32955 } health_report { overall_health: UNKNOWN } } }
I20260812 01:18:10.447016 23508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.444628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34406 (local address 127.17.183.129:39517)
0812 01:18:10.444679 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:10.444681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:10.444690 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:18:10.444750 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:10.444750 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:10.444769 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:10.444853 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:10.444979 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.445470 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.446212 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:10.446421 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:10.446495 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:10.446666 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:10.446770 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:10.446865 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:10.446889 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 01:18:10.446910 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 01:18:10.448794 23136 raft_consensus.cc:1261] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f [term 1 FOLLOWER]: Refusing update from remote peer d880c49387bb46fe9fd8a0b0a7759bf5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:10.448848 23396 raft_consensus.cc:1261] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31 [term 1 FOLLOWER]: Refusing update from remote peer d880c49387bb46fe9fd8a0b0a7759bf5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:10.449216 23534 consensus_queue.cc:1035] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa91b683efc435e9c0417964ad84b6f" member_type: VOTER last_known_addr { host: "127.17.183.130" port: 32955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:10.449361 23531 consensus_queue.cc:1035] T eb89b2eee31f49cf9ad55bba95a6ac47 P d880c49387bb46fe9fd8a0b0a7759bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa45e76bfdab48ceae1a050180f3ac31" member_type: VOTER last_known_addr { host: "127.17.183.131" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:10.451920 23545 mvcc.cc:205] Tried to move back new op lower bound from 7317493720875663360 to 7317493720822497280. Current Snapshot: MvccSnapshot[applied={T|T < 7317493720875663360}]
I20260812 01:18:10.452464 23546 mvcc.cc:205] Tried to move back new op lower bound from 7317493720875663360 to 7317493720822497280. Current Snapshot: MvccSnapshot[applied={T|T < 7317493720875663360}]
I20260812 01:18:10.454005 22669 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:10.454094 22669 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:18:10.454838 22669 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 324578e5d1e44b6f91ec5d3d64691f08: Sending DeleteTablet for 3 replicas of tablet eb89b2eee31f49cf9ad55bba95a6ac47
I20260812 01:18:10.455150 23352 tablet_service.cc:1514] Processing DeleteTablet for tablet eb89b2eee31f49cf9ad55bba95a6ac47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:10 UTC) from {username='slave'} at 127.0.0.1:56742
I20260812 01:18:10.455184 22877 tablet_service.cc:1514] Processing DeleteTablet for tablet eb89b2eee31f49cf9ad55bba95a6ac47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:10 UTC) from {username='slave'} at 127.0.0.1:34404
I20260812 01:18:10.455377 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 22771
I20260812 01:18:10.455381 23560 tablet_replica.cc:330] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31: stopping tablet replica
I20260812 01:18:10.455515 23560 raft_consensus.cc:2229] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:18:10.455616 23560 raft_consensus.cc:2258] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:10.455890 23102 tablet_service.cc:1514] Processing DeleteTablet for tablet eb89b2eee31f49cf9ad55bba95a6ac47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:18:10 UTC) from {username='slave'} at 127.0.0.1:60434
I20260812 01:18:10.462200 23560 ts_tablet_manager.cc:1905] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:10.463927 23563 tablet_replica.cc:330] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f: stopping tablet replica
I20260812 01:18:10.464046 23563 raft_consensus.cc:2229] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:18:10.464160 23563 raft_consensus.cc:2258] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:18:10.464269 23560 ts_tablet_manager.cc:1918] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:10.464342 23560 log.cc:1196] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-2/wal/wals/eb89b2eee31f49cf9ad55bba95a6ac47
I20260812 01:18:10.464589 23560 ts_tablet_manager.cc:1939] T eb89b2eee31f49cf9ad55bba95a6ac47 P fa45e76bfdab48ceae1a050180f3ac31: Deleting consensus metadata
I20260812 01:18:10.464963 22642 catalog_manager.cc:4841] TS fa45e76bfdab48ceae1a050180f3ac31 (127.17.183.131:33813): tablet eb89b2eee31f49cf9ad55bba95a6ac47 (table test-table [id=a35045d909274740b4322ed5602c45b7]) successfully deleted
I20260812 01:18:10.465296 23563 ts_tablet_manager.cc:1905] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:18:10.467072 23563 ts_tablet_manager.cc:1918] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:18:10.467149 23563 log.cc:1196] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f: Deleting WAL directory at /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786497235894345-18142-0/minicluster-data/ts-1/wal/wals/eb89b2eee31f49cf9ad55bba95a6ac47
I20260812 01:18:10.467399 23563 ts_tablet_manager.cc:1939] T eb89b2eee31f49cf9ad55bba95a6ac47 P 0aa91b683efc435e9c0417964ad84b6f: Deleting consensus metadata
I20260812 01:18:10.467778 22643 catalog_manager.cc:4841] TS 0aa91b683efc435e9c0417964ad84b6f (127.17.183.130:32955): tablet eb89b2eee31f49cf9ad55bba95a6ac47 (table test-table [id=a35045d909274740b4322ed5602c45b7]) successfully deleted
W20260812 01:18:10.471864 22643 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.183.129:39517 (error 108)
I20260812 01:18:10.472157 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 22994
I20260812 01:18:10.472365 23500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:10.472215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.129:39517 (local address 127.0.0.1:34412)
0812 01:18:10.472284 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:10.472328 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.129:39517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 01:18:10.491182 22643 catalog_manager.cc:4584] TS d880c49387bb46fe9fd8a0b0a7759bf5 (127.17.183.129:39517): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet eb89b2eee31f49cf9ad55bba95a6ac47: Network error: Client connection negotiation failed: client connection to 127.17.183.129:39517: connect: Connection refused (error 111)
I20260812 01:18:10.496548 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 23237
I20260812 01:18:10.512563 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 22612
2026-08-12T01:18:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (734 ms)
[----------] 6 tests from EncryptionPolicyTest (10432 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:10 dist-test-slave-rwrg krb5kdc[23570](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:10 dist-test-slave-rwrg krb5kdc[23570](info): set up 2 sockets
Aug 12 01:18:10 dist-test-slave-rwrg krb5kdc[23570](info): commencing operation
krb5kdc: starting...
W20260812 01:18:12.030790 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.491s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:12 dist-test-slave-rwrg krb5kdc[23570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:12.149343 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38981
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:12.230350 23590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:12.230553 23590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:12.230572 23590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:12.231679 23590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:12.231717 23590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:12.231730 23590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:12.231755 23590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:12.231802 23590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:12.233253 23590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38981
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:12.233529 23590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:12.233767 23590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:12.238689 23602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:12.238749 23605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:12.238793 23590 server_base.cc:1034] running on GCE node
W20260812 01:18:12.238690 23599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:12.239164 23590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:12.239502 23590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:12.240643 23590 hybrid_clock.cc:648] HybridClock initialized: now 1786497492240631 us; error 33 us; skew 500 ppm
Aug 12 01:18:12 dist-test-slave-rwrg krb5kdc[23570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497492, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:12.243018 23590 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:12.243443 23590 webserver.cc:460] Webserver started at http://127.0.0.1:40373/ using document root <none> and password file <none>
I20260812 01:18:12.243673 23590 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:12.243741 23590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:12.243870 23590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:12.245079 23590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "9fa53ceb62c247dcbf76677b0f02c9c6"
format_stamp: "Formatted at 2026-08-12 01:18:12 on dist-test-slave-rwrg"
server_key: "1d558c6127b247130e8d445dc6540f06"
server_key_iv: "d539a04477f3da8266889ef7438c6d0c"
server_key_version: "encryptionkey@0"
I20260812 01:18:12.245460 23590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "9fa53ceb62c247dcbf76677b0f02c9c6"
format_stamp: "Formatted at 2026-08-12 01:18:12 on dist-test-slave-rwrg"
server_key: "1d558c6127b247130e8d445dc6540f06"
server_key_iv: "d539a04477f3da8266889ef7438c6d0c"
server_key_version: "encryptionkey@0"
I20260812 01:18:12.246791 23590 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:18:12.247510 23621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:12.247689 23590 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:12.247807 23590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "9fa53ceb62c247dcbf76677b0f02c9c6"
format_stamp: "Formatted at 2026-08-12 01:18:12 on dist-test-slave-rwrg"
server_key: "1d558c6127b247130e8d445dc6540f06"
server_key_iv: "d539a04477f3da8266889ef7438c6d0c"
server_key_version: "encryptionkey@0"
I20260812 01:18:12.247885 23590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:12.263736 23590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:12.266149 23590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:12.266337 23590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:12.270252 23590 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38981
I20260812 01:18:12.270283 23717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38981 every 8 connection(s)
I20260812 01:18:12.270648 23590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:12.271514 23721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:12.273782 23721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6: Bootstrap starting.
I20260812 01:18:12.274326 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 23590
I20260812 01:18:12.274459 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:12.274499 23721 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:12.274718 18142 external_mini_cluster.cc:1428] Setting key 377fa64b0d986d3924a76e77ec7e252c
I20260812 01:18:12.274817 23721 log.cc:824] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:12.275832 23721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6: No bootstrap required, opened a new log
I20260812 01:18:12.277896 23721 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa53ceb62c247dcbf76677b0f02c9c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38981 } }
I20260812 01:18:12.278062 23721 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:12.278112 23721 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa53ceb62c247dcbf76677b0f02c9c6, State: Initialized, Role: FOLLOWER
I20260812 01:18:12.278242 23721 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa53ceb62c247dcbf76677b0f02c9c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38981 } }
I20260812 01:18:12.278323 23721 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:12.278369 23721 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:12.278419 23721 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:12.279018 23721 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa53ceb62c247dcbf76677b0f02c9c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38981 } }
I20260812 01:18:12.279140 23721 leader_election.cc:302] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fa53ceb62c247dcbf76677b0f02c9c6; no voters:
I20260812 01:18:12.279322 23721 leader_election.cc:288] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:12.279362 23729 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:12.279515 23729 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa53ceb62c247dcbf76677b0f02c9c6, State: Running, Role: LEADER
I20260812 01:18:12.279613 23729 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa53ceb62c247dcbf76677b0f02c9c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38981 } }
I20260812 01:18:12.279959 23721 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:12.279973 23733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fa53ceb62c247dcbf76677b0f02c9c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa53ceb62c247dcbf76677b0f02c9c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38981 } } }
I20260812 01:18:12.280097 23733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:12.280335 23735 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:12.280929 23735 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 01:18:12 dist-test-slave-rwrg krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 01:18:12.282233 23730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fa53ceb62c247dcbf76677b0f02c9c6. Latest consensus state: current_term: 1 leader_uuid: "9fa53ceb62c247dcbf76677b0f02c9c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa53ceb62c247dcbf76677b0f02c9c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38981 } } }
I20260812 01:18:12.282321 23730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:12.283756 23735 catalog_manager.cc:1347] Generated new cluster ID: 91fc5f87378446fa964411a54a38bb42
I20260812 01:18:12.283811 23735 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:12.286116 23728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:12.275285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58383 (local address 127.0.0.1:38981)
0812 01:18:12.275471 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:12.275480 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:12.275510 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:18:12.275986 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:12.275995 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:12.276054 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:12.276201 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:12.276877 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:12.277736 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:12.278654 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:12.279047 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:12.279183 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:12.282076 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:12.282081 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:12.282081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:12.282093 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:12.284264 (+ 2171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:12.284784 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:12.284787 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:12.284787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:12.284896 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:12.285190 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:12.285191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:12.285191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:12.285484 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:12.285641 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:12.285783 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 01:18:12.285889 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":72,"threads_started":1}
I20260812 01:18:12.287596 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:12.296543 23728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:12.289106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35659 (local address 127.0.0.1:38981)
0812 01:18:12.289147 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:12.289149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:12.289259 (+ 110us) server_negotiation.cc:407] Connection header received
0812 01:18:12.289339 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:12.289340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:12.289351 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:12.289404 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:12.290023 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:12.290761 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:12.291764 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:12.292091 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:12.292156 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:12.293518 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:12.293520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:12.293520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:12.293527 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:12.295114 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:12.295554 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:12.295555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:12.295555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:12.295618 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:12.295860 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:12.295861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:12.295861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:12.295979 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:12.296085 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:12.296246 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 01:18:12.296311 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:18:12.316737 23735 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:12.317337 23735 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:12.333021 23735 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fa53ceb62c247dcbf76677b0f02c9c6: Generated new TSK 0
I20260812 01:18:12.333236 23735 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:12.344987 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 23590
W20260812 01:18:12.366221 23568 connection.cc:535] client connection to 127.0.0.1:38981 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38981): Connection reset by peer (error 104)
2026-08-12T01:18:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1839 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:12 dist-test-slave-rwrg krb5kdc[23778](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:12 dist-test-slave-rwrg krb5kdc[23778](info): set up 2 sockets
Aug 12 01:18:12 dist-test-slave-rwrg krb5kdc[23778](info): commencing operation
krb5kdc: starting...
W20260812 01:18:13.663111 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:13 dist-test-slave-rwrg krb5kdc[23778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497493, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:13.787611 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42049
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:13.871771 23807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:13.871961 23807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:13.871984 23807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:13.873142 23807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:13.873184 23807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:13.873199 23807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:13.873211 23807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:13.873272 23807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:13.874694 23807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42049
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:13.874912 23807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:13.875142 23807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:13.880158 23819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:13.880173 23822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:13.880213 23807 server_base.cc:1034] running on GCE node
W20260812 01:18:13.880167 23824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:13.880671 23807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:13.880901 23807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:13.882068 23807 hybrid_clock.cc:648] HybridClock initialized: now 1786497493882049 us; error 32 us; skew 500 ppm
Aug 12 01:18:13 dist-test-slave-rwrg krb5kdc[23778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497493, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:13.884476 23807 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:13.884943 23807 webserver.cc:460] Webserver started at http://127.0.0.1:41561/ using document root <none> and password file <none>
I20260812 01:18:13.885185 23807 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:13.885255 23807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:13.885425 23807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:13.886421 23807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "82a9e47bb9a24c579bb792146fdfdc92"
format_stamp: "Formatted at 2026-08-12 01:18:13 on dist-test-slave-rwrg"
server_key: "4e5a7230be736e12325c0e2083565336"
server_key_iv: "47d303afcb909969e52944a923ee79ef"
server_key_version: "encryptionkey@0"
I20260812 01:18:13.886781 23807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "82a9e47bb9a24c579bb792146fdfdc92"
format_stamp: "Formatted at 2026-08-12 01:18:13 on dist-test-slave-rwrg"
server_key: "4e5a7230be736e12325c0e2083565336"
server_key_iv: "47d303afcb909969e52944a923ee79ef"
server_key_version: "encryptionkey@0"
I20260812 01:18:13.888123 23807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 01:18:13.888911 23836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:13.889076 23807 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 01:18:13.889182 23807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "82a9e47bb9a24c579bb792146fdfdc92"
format_stamp: "Formatted at 2026-08-12 01:18:13 on dist-test-slave-rwrg"
server_key: "4e5a7230be736e12325c0e2083565336"
server_key_iv: "47d303afcb909969e52944a923ee79ef"
server_key_version: "encryptionkey@0"
I20260812 01:18:13.889271 23807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:13.912750 23807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:13.914691 23807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:13.914862 23807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:13.918977 23807 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42049
I20260812 01:18:13.919023 23932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42049 every 8 connection(s)
I20260812 01:18:13.919549 23807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:13.920264 23935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:13.922482 23935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92: Bootstrap starting.
I20260812 01:18:13.923040 23935 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:13.923030 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 23807
I20260812 01:18:13.923169 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:13.923380 18142 external_mini_cluster.cc:1428] Setting key 6470581a945944381876240aa97c791c
I20260812 01:18:13.923383 23935 log.cc:824] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:13.924209 23935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92: No bootstrap required, opened a new log
I20260812 01:18:13.926913 23935 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a9e47bb9a24c579bb792146fdfdc92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260812 01:18:13.927039 23935 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:13.927062 23935 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a9e47bb9a24c579bb792146fdfdc92, State: Initialized, Role: FOLLOWER
I20260812 01:18:13.927198 23935 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a9e47bb9a24c579bb792146fdfdc92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260812 01:18:13.927273 23935 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:13.927325 23935 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:13.927373 23935 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:13.927930 23935 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a9e47bb9a24c579bb792146fdfdc92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260812 01:18:13.928054 23935 leader_election.cc:302] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82a9e47bb9a24c579bb792146fdfdc92; no voters:
I20260812 01:18:13.928218 23935 leader_election.cc:288] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:13.928242 23949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:13.928362 23949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [term 1 LEADER]: Becoming Leader. State: Replica: 82a9e47bb9a24c579bb792146fdfdc92, State: Running, Role: LEADER
I20260812 01:18:13.928437 23949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a9e47bb9a24c579bb792146fdfdc92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260812 01:18:13.928467 23935 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:13.928784 23949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82a9e47bb9a24c579bb792146fdfdc92. Latest consensus state: current_term: 1 leader_uuid: "82a9e47bb9a24c579bb792146fdfdc92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a9e47bb9a24c579bb792146fdfdc92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } } }
I20260812 01:18:13.928853 23949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:13.928815 23950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82a9e47bb9a24c579bb792146fdfdc92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a9e47bb9a24c579bb792146fdfdc92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } } }
I20260812 01:18:13.928905 23950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:13.929065 23955 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:13.929630 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:13.923885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52321 (local address 127.0.0.1:42049)
0812 01:18:13.924059 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:13.924068 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:13.924100 (+ 32us) server_negotiation.cc:407] Connection header received
0812 01:18:13.924705 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:13.924713 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:13.924774 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:13.924914 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:13.925081 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:13.926511 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:13.927436 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:13.927922 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:13.928070 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:13.928752 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:13.928756 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:13.928757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:13.928968 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:13.929010 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:13.929026 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:13.929116 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:13.929345 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 01:18:13.929377 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
I20260812 01:18:13.929626 23955 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:13.930711 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:13.932127 23955 catalog_manager.cc:1347] Generated new cluster ID: ad59cf6e43594ea288e07e30a8b3c3c5
I20260812 01:18:13.932178 23955 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:13.935346 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:13.932280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55557 (local address 127.0.0.1:42049)
0812 01:18:13.932321 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:13.932323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:13.932682 (+ 359us) server_negotiation.cc:407] Connection header received
0812 01:18:13.932753 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:13.932754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:13.932764 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:13.932821 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:13.932964 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:13.933441 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:13.934145 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:13.934353 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:13.934439 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:13.935096 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:13.935097 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:13.935098 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:13.935102 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:13.935114 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:13.935118 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:13.935173 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:13.935245 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 01:18:13.935254 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:18:13.946338 23955 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:13.947052 23955 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:13.951663 23955 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82a9e47bb9a24c579bb792146fdfdc92: Generated new TSK 0
I20260812 01:18:13.951838 23955 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:13.958297 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 23807
W20260812 01:18:13.988418 23773 connection.cc:535] client connection to 127.0.0.1:42049 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42049): Connection reset by peer (error 104)
2026-08-12T01:18:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1622 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:14 dist-test-slave-rwrg krb5kdc[23991](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:14 dist-test-slave-rwrg krb5kdc[23991](info): set up 2 sockets
Aug 12 01:18:14 dist-test-slave-rwrg krb5kdc[23991](info): commencing operation
krb5kdc: starting...
W20260812 01:18:15.292569 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:15 dist-test-slave-rwrg krb5kdc[23991](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:15.415454 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40843
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:15.496618 24012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:15.496870 24012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:15.496912 24012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:15.498077 24012 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:15.498148 24012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:15.498172 24012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:15.498193 24012 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:15.498220 24012 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:15.499660 24012 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40843
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:15.499949 24012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:15.500169 24012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:15.505142 24019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:15.505123 24020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:15.505252 24012 server_base.cc:1034] running on GCE node
W20260812 01:18:15.505120 24024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:15.505577 24012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:15.505869 24012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:15.507067 24012 hybrid_clock.cc:648] HybridClock initialized: now 1786497495507028 us; error 34 us; skew 500 ppm
Aug 12 01:18:15 dist-test-slave-rwrg krb5kdc[23991](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497495, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:15.512557 24012 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:15.512991 24012 webserver.cc:460] Webserver started at http://127.0.0.1:40001/ using document root <none> and password file <none>
I20260812 01:18:15.513188 24012 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:15.513254 24012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:15.513355 24012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:15.514358 24012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "2d914c64f4544891a6e0b70477c7e1bf"
format_stamp: "Formatted at 2026-08-12 01:18:15 on dist-test-slave-rwrg"
server_key: "f37f0c0846cef4d9fedc61e75c48afaf"
server_key_iv: "669d08b2bd82b46f672a1d6d16313213"
server_key_version: "encryptionkey@0"
I20260812 01:18:15.514669 24012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "2d914c64f4544891a6e0b70477c7e1bf"
format_stamp: "Formatted at 2026-08-12 01:18:15 on dist-test-slave-rwrg"
server_key: "f37f0c0846cef4d9fedc61e75c48afaf"
server_key_iv: "669d08b2bd82b46f672a1d6d16313213"
server_key_version: "encryptionkey@0"
I20260812 01:18:15.515918 24012 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:18:15.516696 24040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:15.516872 24012 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:15.516963 24012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "2d914c64f4544891a6e0b70477c7e1bf"
format_stamp: "Formatted at 2026-08-12 01:18:15 on dist-test-slave-rwrg"
server_key: "f37f0c0846cef4d9fedc61e75c48afaf"
server_key_iv: "669d08b2bd82b46f672a1d6d16313213"
server_key_version: "encryptionkey@0"
I20260812 01:18:15.517017 24012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:15.520097 24012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:15.521858 24012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:15.521960 24012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:15.525902 24012 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40843
I20260812 01:18:15.525951 24137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40843 every 8 connection(s)
I20260812 01:18:15.526253 24012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:15.527240 24139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:15.529577 24139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf: Bootstrap starting.
I20260812 01:18:15.530189 24139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:15.530220 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 24012
I20260812 01:18:15.530395 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:15.530541 24139 log.cc:824] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:15.530632 18142 external_mini_cluster.cc:1428] Setting key d95526226ce4def3d4f64bcd76628585
I20260812 01:18:15.531370 24139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf: No bootstrap required, opened a new log
I20260812 01:18:15.533272 24139 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d914c64f4544891a6e0b70477c7e1bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40843 } }
I20260812 01:18:15.533450 24139 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:15.533488 24139 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d914c64f4544891a6e0b70477c7e1bf, State: Initialized, Role: FOLLOWER
I20260812 01:18:15.533627 24139 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d914c64f4544891a6e0b70477c7e1bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40843 } }
I20260812 01:18:15.533767 24139 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:15.533835 24139 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:15.533892 24139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:15.534291 24151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:15.531198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38857 (local address 127.0.0.1:40843)
0812 01:18:15.531418 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:15.531427 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:15.531482 (+ 55us) server_negotiation.cc:407] Connection header received
0812 01:18:15.532936 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:15.532943 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:15.532972 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:15.533132 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:15.533836 (+ 704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:15.533840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:15.533840 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:15.533845 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:15.533910 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:15.533926 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:15.534016 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:15.534081 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 01:18:15.534122 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260812 01:18:15.535010 24139 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d914c64f4544891a6e0b70477c7e1bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40843 } }
I20260812 01:18:15.535125 24139 leader_election.cc:302] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d914c64f4544891a6e0b70477c7e1bf; no voters:
I20260812 01:18:15.535293 24139 leader_election.cc:288] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:15.535367 24154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:15.535549 24139 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:15.535665 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:15.535694 24154 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [term 1 LEADER]: Becoming Leader. State: Replica: 2d914c64f4544891a6e0b70477c7e1bf, State: Running, Role: LEADER
I20260812 01:18:15.535789 24154 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d914c64f4544891a6e0b70477c7e1bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40843 } }
I20260812 01:18:15.536248 24159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d914c64f4544891a6e0b70477c7e1bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d914c64f4544891a6e0b70477c7e1bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40843 } } }
I20260812 01:18:15.536345 24159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:15.536525 24164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d914c64f4544891a6e0b70477c7e1bf. Latest consensus state: current_term: 1 leader_uuid: "2d914c64f4544891a6e0b70477c7e1bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d914c64f4544891a6e0b70477c7e1bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40843 } } }
I20260812 01:18:15.536595 24164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf [sys.catalog]: This master's current role is: LEADER
W20260812 01:18:15.537706 24194 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:18:15.537882 24194 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:18:15.538012 24174 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:15.538246 24174 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:15.540283 24151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:15.537689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44065 (local address 127.0.0.1:40843)
0812 01:18:15.537740 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:15.537742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:15.538018 (+ 276us) server_negotiation.cc:407] Connection header received
0812 01:18:15.538414 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:15.538415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:15.538421 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:15.538497 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:15.540002 (+ 1505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:15.540003 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:15.540004 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:15.540008 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:15.540022 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:15.540027 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:15.540074 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:15.540211 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 01:18:15.540225 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 01:18:15.541261 24174 catalog_manager.cc:1347] Generated new cluster ID: 01515cf2f54441108d2dad6a7443e78e
I20260812 01:18:15.541323 24174 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:15.553536 24174 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:15.553702 24174 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:15.556654 24174 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d914c64f4544891a6e0b70477c7e1bf: Generated new TSK 0
I20260812 01:18:15.556856 24174 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:15.563263 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 24012
2026-08-12T01:18:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1585 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:15 dist-test-slave-rwrg krb5kdc[24209](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:15 dist-test-slave-rwrg krb5kdc[24209](info): set up 2 sockets
Aug 12 01:18:15 dist-test-slave-rwrg krb5kdc[24209](info): commencing operation
krb5kdc: starting...
W20260812 01:18:16.910385 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:16 dist-test-slave-rwrg krb5kdc[24209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:17.033833 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35627
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:17.116667 24228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:17.116873 24228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:17.116895 24228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:17.118018 24228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:17.118063 24228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:17.118083 24228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:17.118139 24228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:17.118160 24228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:17.119602 24228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35627
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:17.119866 24228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:17.120100 24228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:17.125041 24240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:17.124993 24242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:17.125180 24228 server_base.cc:1034] running on GCE node
W20260812 01:18:17.124994 24239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:17.125540 24228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:17.125864 24228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:17.127048 24228 hybrid_clock.cc:648] HybridClock initialized: now 1786497497127034 us; error 42 us; skew 500 ppm
Aug 12 01:18:17 dist-test-slave-rwrg krb5kdc[24209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497497, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:17.129571 24228 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:17.130000 24228 webserver.cc:460] Webserver started at http://127.0.0.1:34561/ using document root <none> and password file <none>
I20260812 01:18:17.130249 24228 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:17.130319 24228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:17.130471 24228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:17.131507 24228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "943b0e45e9fb47efb6edd603d8d5ad64"
format_stamp: "Formatted at 2026-08-12 01:18:17 on dist-test-slave-rwrg"
server_key: "7bb490d9bfa7349a2d0e4b29613de412"
server_key_iv: "ca63fb1a9d4c8161358f28eafcb6e970"
server_key_version: "encryptionkey@0"
I20260812 01:18:17.131880 24228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "943b0e45e9fb47efb6edd603d8d5ad64"
format_stamp: "Formatted at 2026-08-12 01:18:17 on dist-test-slave-rwrg"
server_key: "7bb490d9bfa7349a2d0e4b29613de412"
server_key_iv: "ca63fb1a9d4c8161358f28eafcb6e970"
server_key_version: "encryptionkey@0"
I20260812 01:18:17.133322 24228 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:17.134042 24257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:17.134214 24228 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:17.134306 24228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "943b0e45e9fb47efb6edd603d8d5ad64"
format_stamp: "Formatted at 2026-08-12 01:18:17 on dist-test-slave-rwrg"
server_key: "7bb490d9bfa7349a2d0e4b29613de412"
server_key_iv: "ca63fb1a9d4c8161358f28eafcb6e970"
server_key_version: "encryptionkey@0"
I20260812 01:18:17.134384 24228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:17.146425 24228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:17.148159 24228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:17.148322 24228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:17.152634 24228 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35627
I20260812 01:18:17.152705 24356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35627 every 8 connection(s)
I20260812 01:18:17.153066 24228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:17.154021 24358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:17.156617 24358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64: Bootstrap starting.
I20260812 01:18:17.157248 24358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:17.157577 24358 log.cc:824] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:17.158308 24358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64: No bootstrap required, opened a new log
I20260812 01:18:17.159487 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 24228
I20260812 01:18:17.159628 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:17.159842 18142 external_mini_cluster.cc:1428] Setting key 519ebaf3958d1eb0072461034b17ce38
I20260812 01:18:17.160457 24358 raft_consensus.cc:348] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "943b0e45e9fb47efb6edd603d8d5ad64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35627 } }
I20260812 01:18:17.160687 24358 raft_consensus.cc:374] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:17.160722 24358 raft_consensus.cc:729] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943b0e45e9fb47efb6edd603d8d5ad64, State: Initialized, Role: FOLLOWER
I20260812 01:18:17.160977 24358 consensus_queue.cc:260] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "943b0e45e9fb47efb6edd603d8d5ad64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35627 } }
I20260812 01:18:17.161341 24365 raft_consensus.cc:482] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:18:17.161417 24365 raft_consensus.cc:504] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "943b0e45e9fb47efb6edd603d8d5ad64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35627 } }
I20260812 01:18:17.161537 24365 leader_election.cc:302] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 943b0e45e9fb47efb6edd603d8d5ad64; no voters:
I20260812 01:18:17.161553 24358 raft_consensus.cc:388] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:17.161602 24358 raft_consensus.cc:482] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:17.161661 24358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:17.161706 24365 leader_election.cc:288] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260812 01:18:17.162463 24358 raft_consensus.cc:504] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "943b0e45e9fb47efb6edd603d8d5ad64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35627 } }
I20260812 01:18:17.162564 24358 leader_election.cc:302] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 943b0e45e9fb47efb6edd603d8d5ad64; no voters:
I20260812 01:18:17.162600 24358 leader_election.cc:288] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:17.162614 24370 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260812 01:18:17.162777 24365 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:17.162853 24358 sys_catalog.cc:564] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:17.162962 24365 raft_consensus.cc:686] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [term 1 LEADER]: Becoming Leader. State: Replica: 943b0e45e9fb47efb6edd603d8d5ad64, State: Running, Role: LEADER
I20260812 01:18:17.163110 24365 consensus_queue.cc:237] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "943b0e45e9fb47efb6edd603d8d5ad64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35627 } }
I20260812 01:18:17.163486 24370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "943b0e45e9fb47efb6edd603d8d5ad64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "943b0e45e9fb47efb6edd603d8d5ad64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35627 } } }
I20260812 01:18:17.163607 24370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:17.163487 24365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 943b0e45e9fb47efb6edd603d8d5ad64. Latest consensus state: current_term: 1 leader_uuid: "943b0e45e9fb47efb6edd603d8d5ad64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "943b0e45e9fb47efb6edd603d8d5ad64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35627 } } }
I20260812 01:18:17.163832 24389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:17.163978 24365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:17.164556 24389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:17.166524 24389 catalog_manager.cc:1347] Generated new cluster ID: 6c79038b61a8407f906351ddc9213245
I20260812 01:18:17.166580 24389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:18:17 dist-test-slave-rwrg krb5kdc[24209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 01:18:17.171746 24364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:17.160408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42037 (local address 127.0.0.1:35627)
0812 01:18:17.160605 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:17.160620 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:17.160645 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:18:17.160792 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:17.160798 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:17.160851 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:17.160996 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:17.161788 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:17.163164 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:17.164360 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:17.164976 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:17.165083 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:17.168075 (+ 2992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:17.168079 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:17.168079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:17.168092 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:17.169992 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:17.170428 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:17.170432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:17.170433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:17.170566 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:17.170801 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:17.170803 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:17.170803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:17.171067 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:17.171255 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:17.171361 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 01:18:17.171535 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":114,"threads_started":1}
I20260812 01:18:17.172806 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:17.182559 24364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:17.174327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43995 (local address 127.0.0.1:35627)
0812 01:18:17.174364 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:17.174366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:17.176756 (+ 2390us) server_negotiation.cc:407] Connection header received
0812 01:18:17.176831 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:17.176832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:17.176843 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:17.176899 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:17.177415 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:17.177910 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:17.178618 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:17.178822 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:17.178898 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:17.180012 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:17.180014 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:17.180014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:17.180020 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:17.181440 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:17.181788 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:17.181790 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:17.181790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:17.181847 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:17.182045 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:17.182046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:17.182046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:17.182154 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:17.182251 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:17.182367 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 01:18:17.182437 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:18:17.222436 24389 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:17.223031 24389 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:17.229758 24389 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 943b0e45e9fb47efb6edd603d8d5ad64: Generated new TSK 0
I20260812 01:18:17.229955 24389 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:17.237197 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 24228
2026-08-12T01:18:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1671 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:17 dist-test-slave-rwrg krb5kdc[24427](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:17 dist-test-slave-rwrg krb5kdc[24427](info): set up 2 sockets
Aug 12 01:18:17 dist-test-slave-rwrg krb5kdc[24427](info): commencing operation
krb5kdc: starting...
W20260812 01:18:18.595352 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:18 dist-test-slave-rwrg krb5kdc[24427](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:18.721383 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43453
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43453
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:18.804873 24450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:18.805079 24450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:18.805104 24450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:18.806365 24450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:18.806406 24450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:18.806420 24450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:18.806433 24450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:18.806484 24450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:18.807966 24450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:18.808197 24450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:18.808410 24450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:18.813308 24456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:18.813366 24457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:18.813366 24459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:18.813689 24450 server_base.cc:1034] running on GCE node
I20260812 01:18:18.813935 24450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:18.814284 24450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:18.815450 24450 hybrid_clock.cc:648] HybridClock initialized: now 1786497498815432 us; error 53 us; skew 500 ppm
Aug 12 01:18:18 dist-test-slave-rwrg krb5kdc[24427](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497498, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:18.818089 24450 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:18.818563 24450 webserver.cc:460] Webserver started at http://127.0.0.1:40941/ using document root <none> and password file <none>
I20260812 01:18:18.818794 24450 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:18.818861 24450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:18.819023 24450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:18.820099 24450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "59a683782e7b4877ac44f65ae64c2c33"
format_stamp: "Formatted at 2026-08-12 01:18:18 on dist-test-slave-rwrg"
server_key: "fc1e6f3668b26dbdb1469b8114cb5bd8"
server_key_iv: "14da6f6e787d413449aedc120a777821"
server_key_version: "encryptionkey@0"
I20260812 01:18:18.820468 24450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "59a683782e7b4877ac44f65ae64c2c33"
format_stamp: "Formatted at 2026-08-12 01:18:18 on dist-test-slave-rwrg"
server_key: "fc1e6f3668b26dbdb1469b8114cb5bd8"
server_key_iv: "14da6f6e787d413449aedc120a777821"
server_key_version: "encryptionkey@0"
I20260812 01:18:18.821874 24450 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:18.822578 24475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:18.822762 24450 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:18.822877 24450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "59a683782e7b4877ac44f65ae64c2c33"
format_stamp: "Formatted at 2026-08-12 01:18:18 on dist-test-slave-rwrg"
server_key: "fc1e6f3668b26dbdb1469b8114cb5bd8"
server_key_iv: "14da6f6e787d413449aedc120a777821"
server_key_version: "encryptionkey@0"
I20260812 01:18:18.822958 24450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:18.832334 24450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:18.834188 24450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:18.834380 24450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:18.838852 24450 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43453
I20260812 01:18:18.838910 24576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43453 every 8 connection(s)
I20260812 01:18:18.839259 24450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:18.840140 24580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:18.842612 24580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33: Bootstrap starting.
I20260812 01:18:18.843271 24580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:18.843575 24580 log.cc:824] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:18.844303 24580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33: No bootstrap required, opened a new log
I20260812 01:18:18.845970 24580 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a683782e7b4877ac44f65ae64c2c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43453 } }
I20260812 01:18:18.846140 24580 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:18.846194 24580 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59a683782e7b4877ac44f65ae64c2c33, State: Initialized, Role: FOLLOWER
I20260812 01:18:18.846342 24580 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a683782e7b4877ac44f65ae64c2c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43453 } }
I20260812 01:18:18.846427 24580 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:18.846473 24580 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:18.846529 24580 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:18.846704 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 24450
I20260812 01:18:18.846830 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:18.847046 18142 external_mini_cluster.cc:1428] Setting key d634451c429847979b6cb1ab3ee171f2
I20260812 01:18:18.847265 24580 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a683782e7b4877ac44f65ae64c2c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43453 } }
I20260812 01:18:18.847385 24580 leader_election.cc:302] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59a683782e7b4877ac44f65ae64c2c33; no voters:
I20260812 01:18:18.847579 24580 leader_election.cc:288] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:18.847611 24589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:18.847743 24589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [term 1 LEADER]: Becoming Leader. State: Replica: 59a683782e7b4877ac44f65ae64c2c33, State: Running, Role: LEADER
I20260812 01:18:18.847899 24580 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:18.847901 24589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a683782e7b4877ac44f65ae64c2c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43453 } }
I20260812 01:18:18.848364 24593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59a683782e7b4877ac44f65ae64c2c33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a683782e7b4877ac44f65ae64c2c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43453 } } }
I20260812 01:18:18.848623 24593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:18.848381 24595 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59a683782e7b4877ac44f65ae64c2c33. Latest consensus state: current_term: 1 leader_uuid: "59a683782e7b4877ac44f65ae64c2c33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a683782e7b4877ac44f65ae64c2c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43453 } } }
I20260812 01:18:18.848809 24595 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33 [sys.catalog]: This master's current role is: LEADER
W20260812 01:18:18.850257 24617 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:18:18.850317 24617 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:18:18.850364 24600 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:18.850508 24600 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:18.852097 24600 catalog_manager.cc:1347] Generated new cluster ID: e20369c240184ab6bc31019999da3146
I20260812 01:18:18.852150 24600 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:18.853550 24592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:18.847534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40827 (local address 127.0.0.1:43453)
0812 01:18:18.847973 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:18.847983 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:18.848018 (+ 35us) server_negotiation.cc:407] Connection header received
0812 01:18:18.848149 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:18.848157 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:18.848212 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:18.848364 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:18.848759 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:18.849918 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:18.851075 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:18.851689 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:18.851798 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:18.852783 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:18.852787 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:18.852788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:18.853002 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:18.853040 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:18.853055 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:18.853097 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:18.853257 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 01:18:18.853320 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":84,"threads_started":1}
I20260812 01:18:18.854635 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:18.859511 24592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:18.856170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38721 (local address 127.0.0.1:43453)
0812 01:18:18.856208 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:18.856210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:18.856268 (+ 58us) server_negotiation.cc:407] Connection header received
0812 01:18:18.856328 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:18.856329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:18.856342 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:18.856420 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:18.856557 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:18.857305 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:18.858250 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:18.858544 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:18.858625 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:18.859285 (+ 660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:18.859286 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:18.859287 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:18.859291 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:18.859305 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:18.859309 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:18.859366 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:18.859420 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 01:18:18.859443 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 01:18:18.864399 24600 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:18.865151 24600 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:18.873278 24600 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59a683782e7b4877ac44f65ae64c2c33: Generated new TSK 0
I20260812 01:18:18.873494 24600 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:18.882902 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 24450
2026-08-12T01:18:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1656 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:18 dist-test-slave-rwrg krb5kdc[24640](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:18 dist-test-slave-rwrg krb5kdc[24640](info): set up 2 sockets
Aug 12 01:18:18 dist-test-slave-rwrg krb5kdc[24640](info): commencing operation
krb5kdc: starting...
W20260812 01:18:20.196306 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:20 dist-test-slave-rwrg krb5kdc[24640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:20.315569 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44141
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:20.398717 24666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:20.398910 24666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:20.398931 24666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:20.400035 24666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:20.400071 24666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:20.400084 24666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:20.400095 24666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:20.400106 24666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:20.401502 24666 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44141
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:20.401690 24666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:20.401849 24666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:20.407346 24679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:20.407456 24683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:20.407323 24677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:20.407536 24666 server_base.cc:1034] running on GCE node
I20260812 01:18:20.407781 24666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:20.408052 24666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:20.409262 24666 hybrid_clock.cc:648] HybridClock initialized: now 1786497500409229 us; error 55 us; skew 500 ppm
Aug 12 01:18:20 dist-test-slave-rwrg krb5kdc[24640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497500, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:20.411827 24666 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:20.412259 24666 webserver.cc:460] Webserver started at http://127.0.0.1:43707/ using document root <none> and password file <none>
I20260812 01:18:20.412438 24666 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:20.412475 24666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:20.412639 24666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:20.413674 24666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "87638e873e6943569c015b437e13953e"
format_stamp: "Formatted at 2026-08-12 01:18:20 on dist-test-slave-rwrg"
server_key: "9c6419120cdf3375a05ee660679410b9"
server_key_iv: "03630ed96466cede2a07f465593f1ab4"
server_key_version: "encryptionkey@0"
I20260812 01:18:20.414000 24666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "87638e873e6943569c015b437e13953e"
format_stamp: "Formatted at 2026-08-12 01:18:20 on dist-test-slave-rwrg"
server_key: "9c6419120cdf3375a05ee660679410b9"
server_key_iv: "03630ed96466cede2a07f465593f1ab4"
server_key_version: "encryptionkey@0"
I20260812 01:18:20.415234 24666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:18:20.416006 24695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:20.416209 24666 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:20.416332 24666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "87638e873e6943569c015b437e13953e"
format_stamp: "Formatted at 2026-08-12 01:18:20 on dist-test-slave-rwrg"
server_key: "9c6419120cdf3375a05ee660679410b9"
server_key_iv: "03630ed96466cede2a07f465593f1ab4"
server_key_version: "encryptionkey@0"
I20260812 01:18:20.416409 24666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:20.419473 24666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:20.421703 24666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:20.421808 24666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:20.425638 24666 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44141
I20260812 01:18:20.425726 24786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44141 every 8 connection(s)
I20260812 01:18:20.426052 24666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:20.427102 24787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:20.429430 24787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e: Bootstrap starting.
I20260812 01:18:20.429989 24787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:20.430300 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 24666
I20260812 01:18:20.430313 24787 log.cc:824] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:20.430436 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:20.430655 18142 external_mini_cluster.cc:1428] Setting key b64e333826f5195f8a74cc4a4dbe3a93
I20260812 01:18:20.431083 24787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e: No bootstrap required, opened a new log
I20260812 01:18:20.432893 24787 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87638e873e6943569c015b437e13953e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44141 } }
I20260812 01:18:20.433075 24787 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:20.433120 24787 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87638e873e6943569c015b437e13953e, State: Initialized, Role: FOLLOWER
I20260812 01:18:20.433297 24787 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87638e873e6943569c015b437e13953e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44141 } }
I20260812 01:18:20.433408 24787 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:20.433447 24787 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:20.433497 24787 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:20.434119 24796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:20.431203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33465 (local address 127.0.0.1:44141)
0812 01:18:20.431391 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:20.431398 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:20.431422 (+ 24us) server_negotiation.cc:407] Connection header received
0812 01:18:20.432880 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:20.432886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:20.432913 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:20.433026 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:20.433708 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:20.433711 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:20.433712 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:20.433716 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:20.433764 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:20.433775 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:20.433849 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:20.433920 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 01:18:20.433959 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
I20260812 01:18:20.434504 24787 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87638e873e6943569c015b437e13953e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44141 } }
I20260812 01:18:20.434630 24787 leader_election.cc:302] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87638e873e6943569c015b437e13953e; no voters:
I20260812 01:18:20.434830 24787 leader_election.cc:288] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:20.434860 24797 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:20.434933 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:20.435012 24797 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [term 1 LEADER]: Becoming Leader. State: Replica: 87638e873e6943569c015b437e13953e, State: Running, Role: LEADER
I20260812 01:18:20.435117 24787 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:20.435102 24797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87638e873e6943569c015b437e13953e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44141 } }
I20260812 01:18:20.435407 24797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87638e873e6943569c015b437e13953e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87638e873e6943569c015b437e13953e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44141 } } }
I20260812 01:18:20.435539 24797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:20.435725 24797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87638e873e6943569c015b437e13953e. Latest consensus state: current_term: 1 leader_uuid: "87638e873e6943569c015b437e13953e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87638e873e6943569c015b437e13953e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44141 } } }
I20260812 01:18:20.435871 24797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:20.436241 24811 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:20.436877 24811 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:20.438524 24811 catalog_manager.cc:1347] Generated new cluster ID: 33eccf0ac5e748c4a2054941c9148245
I20260812 01:18:20.438570 24811 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:20.444219 24796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:20.436836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46149 (local address 127.0.0.1:44141)
0812 01:18:20.436873 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:20.436875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:20.443287 (+ 6412us) server_negotiation.cc:407] Connection header received
0812 01:18:20.443371 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:20.443372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:20.443377 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:20.443437 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:20.444003 (+ 566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:20.444005 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:20.444005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:20.444009 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:20.444022 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:20.444026 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:20.444076 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:20.444152 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 01:18:20.444163 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:18:20.450490 24811 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:20.450644 24811 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:20.455369 24811 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87638e873e6943569c015b437e13953e: Generated new TSK 0
I20260812 01:18:20.455542 24811 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:20.463145 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 24666
2026-08-12T01:18:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1586 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:20 dist-test-slave-rwrg krb5kdc[24843](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:20 dist-test-slave-rwrg krb5kdc[24843](info): set up 2 sockets
Aug 12 01:18:20 dist-test-slave-rwrg krb5kdc[24843](info): commencing operation
krb5kdc: starting...
W20260812 01:18:21.791460 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:21 dist-test-slave-rwrg krb5kdc[24843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:21.918735 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36317
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:22.002166 24871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:22.002368 24871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:22.002389 24871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:22.003536 24871 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:22.003587 24871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:22.003600 24871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:22.003613 24871 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:22.003624 24871 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:22.005231 24871 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:22.005489 24871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:22.005735 24871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:22.011144 24883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:22.011132 24888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:22.011181 24871 server_base.cc:1034] running on GCE node
W20260812 01:18:22.011132 24884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:22.011605 24871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:22.011901 24871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:22.013046 24871 hybrid_clock.cc:648] HybridClock initialized: now 1786497502013014 us; error 51 us; skew 500 ppm
Aug 12 01:18:22 dist-test-slave-rwrg krb5kdc[24843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497502, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:22.015511 24871 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:22.015988 24871 webserver.cc:460] Webserver started at http://127.0.0.1:39289/ using document root <none> and password file <none>
I20260812 01:18:22.016247 24871 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:22.016319 24871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:22.016474 24871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:22.017535 24871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "4356a3ef56db4151977fc1b541b12b9d"
format_stamp: "Formatted at 2026-08-12 01:18:22 on dist-test-slave-rwrg"
server_key: "56510b2a5783f83d33fb8aa64d1bd860"
server_key_iv: "8d530da45c9b3956c022f777ef874c9d"
server_key_version: "encryptionkey@0"
I20260812 01:18:22.017902 24871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "4356a3ef56db4151977fc1b541b12b9d"
format_stamp: "Formatted at 2026-08-12 01:18:22 on dist-test-slave-rwrg"
server_key: "56510b2a5783f83d33fb8aa64d1bd860"
server_key_iv: "8d530da45c9b3956c022f777ef874c9d"
server_key_version: "encryptionkey@0"
I20260812 01:18:22.019205 24871 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:18:22.019897 24897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:22.020076 24871 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:22.020183 24871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "4356a3ef56db4151977fc1b541b12b9d"
format_stamp: "Formatted at 2026-08-12 01:18:22 on dist-test-slave-rwrg"
server_key: "56510b2a5783f83d33fb8aa64d1bd860"
server_key_iv: "8d530da45c9b3956c022f777ef874c9d"
server_key_version: "encryptionkey@0"
I20260812 01:18:22.020257 24871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:22.032298 24871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:22.034300 24871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:22.034476 24871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:22.039172 24871 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36317
I20260812 01:18:22.039224 25001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36317 every 8 connection(s)
I20260812 01:18:22.039633 24871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:22.040642 25002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:22.043016 25002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d: Bootstrap starting.
I20260812 01:18:22.043587 25002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:22.043836 25002 log.cc:824] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:22.044188 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 24871
I20260812 01:18:22.044341 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:22.044623 18142 external_mini_cluster.cc:1428] Setting key 7c7b21007da9d21719d1a08c6731f24a
I20260812 01:18:22.044785 25002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d: No bootstrap required, opened a new log
I20260812 01:18:22.046756 25002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4356a3ef56db4151977fc1b541b12b9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } }
I20260812 01:18:22.046939 25002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:22.046981 25002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4356a3ef56db4151977fc1b541b12b9d, State: Initialized, Role: FOLLOWER
I20260812 01:18:22.047139 25002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4356a3ef56db4151977fc1b541b12b9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } }
I20260812 01:18:22.047233 25002 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:22.047274 25002 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:22.047328 25002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:22.048400 25002 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4356a3ef56db4151977fc1b541b12b9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } }
I20260812 01:18:22.048554 25002 leader_election.cc:302] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4356a3ef56db4151977fc1b541b12b9d; no voters:
I20260812 01:18:22.048769 25002 leader_election.cc:288] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:22.048795 25012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:22.048916 25012 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [term 1 LEADER]: Becoming Leader. State: Replica: 4356a3ef56db4151977fc1b541b12b9d, State: Running, Role: LEADER
I20260812 01:18:22.049064 25002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:22.049068 25012 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4356a3ef56db4151977fc1b541b12b9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } }
I20260812 01:18:22.049692 25013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4356a3ef56db4151977fc1b541b12b9d. Latest consensus state: current_term: 1 leader_uuid: "4356a3ef56db4151977fc1b541b12b9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4356a3ef56db4151977fc1b541b12b9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } } }
I20260812 01:18:22.049789 25013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:22.050025 25023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4356a3ef56db4151977fc1b541b12b9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4356a3ef56db4151977fc1b541b12b9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } } }
I20260812 01:18:22.050381 25023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:22.050586 25034 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:22.051146 25034 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:22.052861 25034 catalog_manager.cc:1347] Generated new cluster ID: e3f8e6d50e584975b47045a486f0b9e8
I20260812 01:18:22.052917 25034 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:18:22 dist-test-slave-rwrg krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 01:18:22.057739 25010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:22.045317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:52839 (local address 127.0.0.1:36317)
0812 01:18:22.045510 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:22.045519 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:22.045550 (+ 31us) server_negotiation.cc:407] Connection header received
0812 01:18:22.046734 (+ 1184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:22.046741 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:22.046795 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:22.046914 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:22.047807 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:22.048933 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:22.050007 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:22.050608 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:22.050878 (+ 270us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:22.053686 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:22.053690 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:22.053691 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:22.053703 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:22.055789 (+ 2086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:22.056236 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:22.056240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:22.056240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:22.056376 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:22.056616 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:22.056617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:22.056617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:22.056940 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:22.057136 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:22.057226 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 01:18:22.057331 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":102,"threads_started":1}
I20260812 01:18:22.058846 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:22.063145 25034 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:22.063824 25034 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:22.067521 25034 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4356a3ef56db4151977fc1b541b12b9d: Generated new TSK 0
I20260812 01:18:22.067699 25034 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:22.068264 25010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:22.060450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:37945 (local address 127.0.0.1:36317)
0812 01:18:22.060483 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:22.060484 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:22.060690 (+ 206us) server_negotiation.cc:407] Connection header received
0812 01:18:22.060749 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:22.060750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:22.060759 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:22.060809 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:22.061458 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:22.062257 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:22.063318 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:22.063645 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:22.063720 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:22.065165 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:22.065167 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:22.065167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:22.065175 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:22.066800 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:22.067293 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:22.067294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:22.067295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:22.067358 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:22.067610 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:22.067611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:22.067612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:22.067754 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:22.067859 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:22.068095 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 01:18:22.068170 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":16}
I20260812 01:18:22.070220 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 24871
W20260812 01:18:22.095530 24840 connection.cc:535] client connection to 127.0.0.1:36317 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36317): Connection reset by peer (error 104)
2026-08-12T01:18:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1606 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:22 dist-test-slave-rwrg krb5kdc[25064](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:22 dist-test-slave-rwrg krb5kdc[25064](info): set up 2 sockets
Aug 12 01:18:22 dist-test-slave-rwrg krb5kdc[25064](info): commencing operation
krb5kdc: starting...
W20260812 01:18:23.395963 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:23 dist-test-slave-rwrg krb5kdc[25064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:23.523403 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33945
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:23.607604 25090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:23.607875 25090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:23.607913 25090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:23.609162 25090 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:23.609261 25090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:23.609289 25090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:23.609359 25090 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:23.609380 25090 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:23.610891 25090 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33945
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:23.611181 25090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:23.611410 25090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:23.616353 25110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:23.616413 25101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:23.616458 25090 server_base.cc:1034] running on GCE node
W20260812 01:18:23.616360 25106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:23.616920 25090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:23.617249 25090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:23.618418 25090 hybrid_clock.cc:648] HybridClock initialized: now 1786497503618405 us; error 40 us; skew 500 ppm
Aug 12 01:18:23 dist-test-slave-rwrg krb5kdc[25064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497503, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:23.620972 25090 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:23.621426 25090 webserver.cc:460] Webserver started at http://127.0.0.1:40913/ using document root <none> and password file <none>
I20260812 01:18:23.621691 25090 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:23.621740 25090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:23.621920 25090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:23.623021 25090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "ff5b2f0ee1124331903db47c86409bbc"
format_stamp: "Formatted at 2026-08-12 01:18:23 on dist-test-slave-rwrg"
server_key: "a42388783f7c64a80be03770dec77f3e"
server_key_iv: "1f9fad6ac8ccd9133867a6a7c58b3a18"
server_key_version: "encryptionkey@0"
I20260812 01:18:23.623401 25090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "ff5b2f0ee1124331903db47c86409bbc"
format_stamp: "Formatted at 2026-08-12 01:18:23 on dist-test-slave-rwrg"
server_key: "a42388783f7c64a80be03770dec77f3e"
server_key_iv: "1f9fad6ac8ccd9133867a6a7c58b3a18"
server_key_version: "encryptionkey@0"
I20260812 01:18:23.624743 25090 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 01:18:23.625464 25119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:23.625680 25090 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:23.625762 25090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "ff5b2f0ee1124331903db47c86409bbc"
format_stamp: "Formatted at 2026-08-12 01:18:23 on dist-test-slave-rwrg"
server_key: "a42388783f7c64a80be03770dec77f3e"
server_key_iv: "1f9fad6ac8ccd9133867a6a7c58b3a18"
server_key_version: "encryptionkey@0"
I20260812 01:18:23.625815 25090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:23.646529 25090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:23.648609 25090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:23.648725 25090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:23.652890 25090 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33945
I20260812 01:18:23.652943 25232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33945 every 8 connection(s)
I20260812 01:18:23.653375 25090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:23.654274 25233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:23.656766 25233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc: Bootstrap starting.
I20260812 01:18:23.657388 25233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:23.657697 25233 log.cc:824] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:23.658414 25233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc: No bootstrap required, opened a new log
I20260812 01:18:23.659459 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 25090
I20260812 01:18:23.659602 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:23.659834 18142 external_mini_cluster.cc:1428] Setting key 8e09a25215564e8221ca1d5af4ed5514
I20260812 01:18:23.660732 25233 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5b2f0ee1124331903db47c86409bbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33945 } }
I20260812 01:18:23.660914 25233 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:23.660952 25233 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff5b2f0ee1124331903db47c86409bbc, State: Initialized, Role: FOLLOWER
I20260812 01:18:23.661147 25233 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5b2f0ee1124331903db47c86409bbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33945 } }
I20260812 01:18:23.661259 25233 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:23.661306 25233 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:23.661360 25233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:23.661904 25233 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5b2f0ee1124331903db47c86409bbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33945 } }
I20260812 01:18:23.662020 25233 leader_election.cc:302] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff5b2f0ee1124331903db47c86409bbc; no voters:
I20260812 01:18:23.662216 25233 leader_election.cc:288] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:23.662250 25242 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:23.662359 25242 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [term 1 LEADER]: Becoming Leader. State: Replica: ff5b2f0ee1124331903db47c86409bbc, State: Running, Role: LEADER
I20260812 01:18:23.662482 25233 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:23.662495 25242 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5b2f0ee1124331903db47c86409bbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33945 } }
I20260812 01:18:23.662927 25244 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff5b2f0ee1124331903db47c86409bbc. Latest consensus state: current_term: 1 leader_uuid: "ff5b2f0ee1124331903db47c86409bbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5b2f0ee1124331903db47c86409bbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33945 } } }
I20260812 01:18:23.662940 25243 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff5b2f0ee1124331903db47c86409bbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5b2f0ee1124331903db47c86409bbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33945 } } }
I20260812 01:18:23.663098 25243 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:23.663304 25244 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:23.663525 25253 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:23.664083 25253 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:23.666205 25253 catalog_manager.cc:1347] Generated new cluster ID: ab73f377cd4f4525bf289e4256f1ae11
I20260812 01:18:23.666256 25253 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:23.666256 25240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:23.660388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:45105 (local address 127.0.0.1:33945)
0812 01:18:23.660595 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:23.660602 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:23.660629 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:18:23.660725 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:23.660730 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:23.660791 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:23.660901 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:23.661177 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:23.662751 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:23.663837 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:23.664414 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:23.664543 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:23.665427 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:23.665431 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:23.665432 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:23.665677 (+ 245us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:23.665734 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:23.665751 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:23.665863 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:23.666001 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 01:18:23.666032 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":96,"threads_started":1}
I20260812 01:18:23.669835 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:23.674765 25240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:23.671385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:39059 (local address 127.0.0.1:33945)
0812 01:18:23.671420 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:23.671422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:23.671430 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:18:23.671480 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:23.671481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:23.671490 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:23.671556 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:23.671684 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:23.672413 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:23.673411 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:23.673733 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:23.673808 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:23.674514 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:23.674515 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:23.674515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:23.674520 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:23.674536 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:23.674540 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:23.674607 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:23.674673 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 01:18:23.674686 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 01:18:23.684123 25253 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:23.685724 25253 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:23.696065 25253 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff5b2f0ee1124331903db47c86409bbc: Generated new TSK 0
I20260812 01:18:23.696277 25253 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:23.700412 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 25090
W20260812 01:18:23.713382 25060 connection.cc:535] client connection to 127.0.0.1:33945 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33945): Connection reset by peer (error 104)
2026-08-12T01:18:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1617 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:23 dist-test-slave-rwrg krb5kdc[25294](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:23 dist-test-slave-rwrg krb5kdc[25294](info): set up 2 sockets
Aug 12 01:18:23 dist-test-slave-rwrg krb5kdc[25294](info): commencing operation
krb5kdc: starting...
W20260812 01:18:25.006695 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:25 dist-test-slave-rwrg krb5kdc[25294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:25.130904 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43773
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:25.216223 25317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:25.216467 25317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:25.216537 25317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:25.217690 25317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:25.217760 25317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:25.217788 25317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:25.217819 25317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:25.217850 25317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:25.219380 25317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43773
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:25.219684 25317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:25.219928 25317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:25.224874 25329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:25.224900 25326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:25.225076 25333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:25.225409 25317 server_base.cc:1034] running on GCE node
I20260812 01:18:25.225708 25317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:25.225942 25317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:25.227089 25317 hybrid_clock.cc:648] HybridClock initialized: now 1786497505227058 us; error 53 us; skew 500 ppm
Aug 12 01:18:25 dist-test-slave-rwrg krb5kdc[25294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497505, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:25.229712 25317 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:25.230171 25317 webserver.cc:460] Webserver started at http://127.0.0.1:43735/ using document root <none> and password file <none>
I20260812 01:18:25.230419 25317 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:25.230489 25317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:25.230636 25317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:25.231678 25317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "70ea9cde980b4788b104a18457dd2284"
format_stamp: "Formatted at 2026-08-12 01:18:25 on dist-test-slave-rwrg"
server_key: "ac4572da2862ec6e8fa1b75c03705c9e"
server_key_iv: "745dc2947b7d1da3798df0d774d2039a"
server_key_version: "encryptionkey@0"
I20260812 01:18:25.232039 25317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "70ea9cde980b4788b104a18457dd2284"
format_stamp: "Formatted at 2026-08-12 01:18:25 on dist-test-slave-rwrg"
server_key: "ac4572da2862ec6e8fa1b75c03705c9e"
server_key_iv: "745dc2947b7d1da3798df0d774d2039a"
server_key_version: "encryptionkey@0"
I20260812 01:18:25.233448 25317 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:25.234229 25344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:25.234414 25317 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:25.234577 25317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "70ea9cde980b4788b104a18457dd2284"
format_stamp: "Formatted at 2026-08-12 01:18:25 on dist-test-slave-rwrg"
server_key: "ac4572da2862ec6e8fa1b75c03705c9e"
server_key_iv: "745dc2947b7d1da3798df0d774d2039a"
server_key_version: "encryptionkey@0"
I20260812 01:18:25.234658 25317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:25.238046 25317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:25.239809 25317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:25.239969 25317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:25.244114 25317 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43773
I20260812 01:18:25.244163 25440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43773 every 8 connection(s)
I20260812 01:18:25.244544 25317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:25.245514 25443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:25.245667 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 25317
I20260812 01:18:25.245817 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:25.246042 18142 external_mini_cluster.cc:1428] Setting key 866f58f00248c644a58b9d76295a76b4
I20260812 01:18:25.248562 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:25.246560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:53799 (local address 127.0.0.1:43773)
0812 01:18:25.246784 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:25.246794 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:25.246829 (+ 35us) server_negotiation.cc:407] Connection header received
0812 01:18:25.247311 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:25.247320 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:25.247353 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:25.247502 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:25.248137 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:25.248140 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:25.248141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:25.248145 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:25.248186 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:25.248199 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:25.248278 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:25.248316 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 01:18:25.248357 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":94,"threads_started":1}
I20260812 01:18:25.249192 25443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284: Bootstrap starting.
I20260812 01:18:25.249673 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:25.249979 25443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:25.250316 25443 log.cc:824] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:25.251139 25443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284: No bootstrap required, opened a new log
I20260812 01:18:25.252380 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:25.251278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:42369 (local address 127.0.0.1:43773)
0812 01:18:25.251320 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:25.251322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:25.251521 (+ 199us) server_negotiation.cc:407] Connection header received
0812 01:18:25.251551 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:25.251552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:25.251555 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:25.251628 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:25.252175 (+ 547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:25.252177 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:25.252177 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:25.252181 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:25.252194 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:25.252198 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:25.252269 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:25.252304 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 01:18:25.252316 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:18:25.253553 25443 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ea9cde980b4788b104a18457dd2284" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43773 } }
I20260812 01:18:25.253680 25443 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:25.253702 25443 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ea9cde980b4788b104a18457dd2284, State: Initialized, Role: FOLLOWER
I20260812 01:18:25.253829 25443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ea9cde980b4788b104a18457dd2284" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43773 } }
I20260812 01:18:25.253928 25443 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:25.253949 25443 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:25.253976 25443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:25.254522 25443 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ea9cde980b4788b104a18457dd2284" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43773 } }
I20260812 01:18:25.254606 25443 leader_election.cc:302] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70ea9cde980b4788b104a18457dd2284; no voters:
I20260812 01:18:25.254772 25443 leader_election.cc:288] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:25.254839 25460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:25.255040 25443 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:25.255021 25460 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [term 1 LEADER]: Becoming Leader. State: Replica: 70ea9cde980b4788b104a18457dd2284, State: Running, Role: LEADER
I20260812 01:18:25.255177 25460 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ea9cde980b4788b104a18457dd2284" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43773 } }
I20260812 01:18:25.255585 25462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70ea9cde980b4788b104a18457dd2284" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ea9cde980b4788b104a18457dd2284" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43773 } } }
I20260812 01:18:25.255784 25463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70ea9cde980b4788b104a18457dd2284. Latest consensus state: current_term: 1 leader_uuid: "70ea9cde980b4788b104a18457dd2284" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ea9cde980b4788b104a18457dd2284" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43773 } } }
I20260812 01:18:25.255869 25462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:25.255918 25463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:25.256299 25475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:25.256953 25475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:25.258533 25475 catalog_manager.cc:1347] Generated new cluster ID: 84c9362bac8943a2baa72b6ab65c8f6c
I20260812 01:18:25.258618 25475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:25.269038 25475 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:25.269192 25475 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:25.275516 25475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70ea9cde980b4788b104a18457dd2284: Generated new TSK 0
I20260812 01:18:25.275689 25475 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:25.277156 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 25317
2026-08-12T01:18:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1568 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:25 dist-test-slave-rwrg krb5kdc[25494](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:25 dist-test-slave-rwrg krb5kdc[25494](info): set up 2 sockets
Aug 12 01:18:25 dist-test-slave-rwrg krb5kdc[25494](info): commencing operation
krb5kdc: starting...
W20260812 01:18:26.583220 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:26 dist-test-slave-rwrg krb5kdc[25494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:26.707104 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36809
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36809
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:26.788455 25520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:26.788733 25520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:26.788770 25520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:26.789917 25520 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:26.789984 25520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:26.790011 25520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:26.790045 25520 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:26.790068 25520 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:26.791559 25520 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36809
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:26.791836 25520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:26.792068 25520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:26.796886 25525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:26.797032 25520 server_base.cc:1034] running on GCE node
W20260812 01:18:26.796869 25532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:26.796871 25526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:26.797385 25520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:26.797691 25520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:26.798871 25520 hybrid_clock.cc:648] HybridClock initialized: now 1786497506798855 us; error 42 us; skew 500 ppm
Aug 12 01:18:26 dist-test-slave-rwrg krb5kdc[25494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497506, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:26.811054 25520 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:26.811540 25520 webserver.cc:460] Webserver started at http://127.0.0.1:37461/ using document root <none> and password file <none>
I20260812 01:18:26.811779 25520 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:26.811847 25520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:26.812018 25520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:26.813180 25520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "603356e764b14ab6891aeaa849cfaef9"
format_stamp: "Formatted at 2026-08-12 01:18:26 on dist-test-slave-rwrg"
server_key: "c42fa37a1dc53bc5d0d4a977227fe4ec"
server_key_iv: "7553bcce974de14e43febcf1ed896bee"
server_key_version: "encryptionkey@0"
I20260812 01:18:26.813568 25520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "603356e764b14ab6891aeaa849cfaef9"
format_stamp: "Formatted at 2026-08-12 01:18:26 on dist-test-slave-rwrg"
server_key: "c42fa37a1dc53bc5d0d4a977227fe4ec"
server_key_iv: "7553bcce974de14e43febcf1ed896bee"
server_key_version: "encryptionkey@0"
I20260812 01:18:26.814953 25520 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:18:26.815718 25546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:26.815919 25520 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:26.816022 25520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "603356e764b14ab6891aeaa849cfaef9"
format_stamp: "Formatted at 2026-08-12 01:18:26 on dist-test-slave-rwrg"
server_key: "c42fa37a1dc53bc5d0d4a977227fe4ec"
server_key_iv: "7553bcce974de14e43febcf1ed896bee"
server_key_version: "encryptionkey@0"
I20260812 01:18:26.816123 25520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:26.827610 25520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:26.829636 25520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:26.829807 25520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:26.834303 25520 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36809
I20260812 01:18:26.834352 25642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36809 every 8 connection(s)
I20260812 01:18:26.834723 25520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:26.835634 25645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:26.837888 25645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9: Bootstrap starting.
I20260812 01:18:26.838428 25645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:26.838670 25645 log.cc:824] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:26.839316 25645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9: No bootstrap required, opened a new log
I20260812 01:18:26.840963 25645 raft_consensus.cc:348] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "603356e764b14ab6891aeaa849cfaef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36809 } }
I20260812 01:18:26.841104 25645 raft_consensus.cc:374] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:26.841128 25645 raft_consensus.cc:729] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 603356e764b14ab6891aeaa849cfaef9, State: Initialized, Role: FOLLOWER
I20260812 01:18:26.841264 25645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "603356e764b14ab6891aeaa849cfaef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36809 } }
I20260812 01:18:26.841351 25645 raft_consensus.cc:388] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:26.841373 25645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:26.841401 25645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:26.841886 25645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "603356e764b14ab6891aeaa849cfaef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36809 } }
I20260812 01:18:26.841966 25645 leader_election.cc:302] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 603356e764b14ab6891aeaa849cfaef9; no voters:
I20260812 01:18:26.842089 25645 leader_election.cc:288] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:26.842159 25649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:26.842335 25649 raft_consensus.cc:686] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [term 1 LEADER]: Becoming Leader. State: Replica: 603356e764b14ab6891aeaa849cfaef9, State: Running, Role: LEADER
I20260812 01:18:26.842346 25645 sys_catalog.cc:564] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:26.842435 25649 consensus_queue.cc:237] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "603356e764b14ab6891aeaa849cfaef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36809 } }
I20260812 01:18:26.842638 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 25520
I20260812 01:18:26.842782 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:26.842854 25652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "603356e764b14ab6891aeaa849cfaef9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "603356e764b14ab6891aeaa849cfaef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36809 } } }
I20260812 01:18:26.842937 25652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:26.842995 18142 external_mini_cluster.cc:1428] Setting key ee05895037ef11effafe835d0855cec6
I20260812 01:18:26.843155 25657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:26.843266 25653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 603356e764b14ab6891aeaa849cfaef9. Latest consensus state: current_term: 1 leader_uuid: "603356e764b14ab6891aeaa849cfaef9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "603356e764b14ab6891aeaa849cfaef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36809 } } }
I20260812 01:18:26.843348 25653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:26.843746 25657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:26.845463 25657 catalog_manager.cc:1347] Generated new cluster ID: 239319b67f1b4cfb9a537f863ffe922d
I20260812 01:18:26.845517 25657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:18:26 dist-test-slave-rwrg krb5kdc[25494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 01:18:26.854801 25657 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:26.855270 25657 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:26.855816 25661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:26.843705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:57489 (local address 127.0.0.1:36809)
0812 01:18:26.844216 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:26.844226 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:26.844269 (+ 43us) server_negotiation.cc:407] Connection header received
0812 01:18:26.844401 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:26.844408 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:26.844468 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:26.845546 (+ 1078us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:26.845644 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:26.846990 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:26.848131 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:26.848744 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:26.848841 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:26.851681 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:26.851685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:26.851686 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:26.851698 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:26.853790 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:26.854252 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:26.854256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:26.854256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:26.854361 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:26.854608 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:26.854609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:26.854609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:26.854890 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:26.855042 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:26.855466 (+ 424us) server_negotiation.cc:299] Negotiation successful
0812 01:18:26.855570 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":83,"threads_started":1}
I20260812 01:18:26.856921 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:26.864820 25657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 603356e764b14ab6891aeaa849cfaef9: Generated new TSK 0
I20260812 01:18:26.865002 25657 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:26.865715 25661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:26.858462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:59347 (local address 127.0.0.1:36809)
0812 01:18:26.858500 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:26.858502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:26.858525 (+ 23us) server_negotiation.cc:407] Connection header received
0812 01:18:26.858545 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:26.858546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:26.858570 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:26.858623 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:26.859193 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:26.859979 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:26.861001 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:26.861314 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:26.861388 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:26.862666 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:26.862667 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:26.862667 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:26.862674 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:26.864227 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:26.864831 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:26.864832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:26.864832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:26.864896 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:26.865154 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:26.865155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:26.865156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:26.865284 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:26.865360 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:26.865609 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 01:18:26.865662 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 01:18:26.868206 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 25520
W20260812 01:18:26.890036 25492 connection.cc:535] client connection to 127.0.0.1:36809 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36809): Connection reset by peer (error 104)
2026-08-12T01:18:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1607 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:26 dist-test-slave-rwrg krb5kdc[25700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:26 dist-test-slave-rwrg krb5kdc[25700](info): set up 2 sockets
Aug 12 01:18:26 dist-test-slave-rwrg krb5kdc[25700](info): commencing operation
krb5kdc: starting...
W20260812 01:18:28.211568 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:28 dist-test-slave-rwrg krb5kdc[25700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:28.331751 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34647
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:28.416841 25729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:28.417076 25729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:28.417114 25729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:28.418272 25729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:28.418340 25729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:28.418363 25729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:28.418385 25729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:28.418413 25729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:28.419999 25729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34647
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:28.420298 25729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:28.420574 25729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:28.425480 25736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:28.425496 25741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:28.425490 25737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:28.425694 25729 server_base.cc:1034] running on GCE node
I20260812 01:18:28.425942 25729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:28.426191 25729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:28.427335 25729 hybrid_clock.cc:648] HybridClock initialized: now 1786497508427322 us; error 29 us; skew 500 ppm
Aug 12 01:18:28 dist-test-slave-rwrg krb5kdc[25700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497508, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:28.429831 25729 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:28.430260 25729 webserver.cc:460] Webserver started at http://127.0.0.1:43437/ using document root <none> and password file <none>
I20260812 01:18:28.430508 25729 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:28.430553 25729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:28.430722 25729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:28.431797 25729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "73489f935c5b4752995b258e010a3087"
format_stamp: "Formatted at 2026-08-12 01:18:28 on dist-test-slave-rwrg"
server_key: "ea1103b8d46610094790d27db0ba9fe6"
server_key_iv: "f5c135a347fb3858de14f87def7ea944"
server_key_version: "encryptionkey@0"
I20260812 01:18:28.432160 25729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "73489f935c5b4752995b258e010a3087"
format_stamp: "Formatted at 2026-08-12 01:18:28 on dist-test-slave-rwrg"
server_key: "ea1103b8d46610094790d27db0ba9fe6"
server_key_iv: "f5c135a347fb3858de14f87def7ea944"
server_key_version: "encryptionkey@0"
I20260812 01:18:28.433557 25729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:28.434304 25749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:28.434489 25729 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:28.434587 25729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "73489f935c5b4752995b258e010a3087"
format_stamp: "Formatted at 2026-08-12 01:18:28 on dist-test-slave-rwrg"
server_key: "ea1103b8d46610094790d27db0ba9fe6"
server_key_iv: "f5c135a347fb3858de14f87def7ea944"
server_key_version: "encryptionkey@0"
I20260812 01:18:28.434666 25729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:28.454805 25729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:28.456815 25729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:28.456984 25729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:28.461030 25729 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34647
I20260812 01:18:28.461078 25845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34647 every 8 connection(s)
I20260812 01:18:28.461460 25729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:28.462467 25847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:28.464941 25847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087: Bootstrap starting.
I20260812 01:18:28.465538 25847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:28.465850 25847 log.cc:824] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:28.466585 25847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087: No bootstrap required, opened a new log
I20260812 01:18:28.467231 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 25729
I20260812 01:18:28.467332 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:28.467571 18142 external_mini_cluster.cc:1428] Setting key c03b2992fe4c3a236dbaf8579a90b5cc
I20260812 01:18:28.468881 25847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73489f935c5b4752995b258e010a3087" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } }
I20260812 01:18:28.469061 25847 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:28.469139 25847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73489f935c5b4752995b258e010a3087, State: Initialized, Role: FOLLOWER
I20260812 01:18:28.469348 25847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73489f935c5b4752995b258e010a3087" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } }
I20260812 01:18:28.469457 25847 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:28.469506 25847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:28.469555 25847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:28.470129 25847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73489f935c5b4752995b258e010a3087" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } }
I20260812 01:18:28.470255 25847 leader_election.cc:302] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73489f935c5b4752995b258e010a3087; no voters:
I20260812 01:18:28.470422 25847 leader_election.cc:288] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:28.470445 25859 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:28.470566 25859 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [term 1 LEADER]: Becoming Leader. State: Replica: 73489f935c5b4752995b258e010a3087, State: Running, Role: LEADER
I20260812 01:18:28.470703 25847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:28.470712 25859 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73489f935c5b4752995b258e010a3087" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } }
I20260812 01:18:28.471235 25862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73489f935c5b4752995b258e010a3087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73489f935c5b4752995b258e010a3087" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } } }
I20260812 01:18:28.471366 25862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:28.471851 25876 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:28.472285 25863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73489f935c5b4752995b258e010a3087. Latest consensus state: current_term: 1 leader_uuid: "73489f935c5b4752995b258e010a3087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73489f935c5b4752995b258e010a3087" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } } }
I20260812 01:18:28.472375 25863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:28.473104 25876 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:28.474352 25858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:28.468132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:58611 (local address 127.0.0.1:34647)
0812 01:18:28.468345 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:28.468356 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:28.468392 (+ 36us) server_negotiation.cc:407] Connection header received
0812 01:18:28.468835 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:28.468844 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:28.468913 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:28.469066 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:28.469338 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:28.470763 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:28.472085 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:28.472592 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:28.472694 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:28.473478 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:28.473481 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:28.473482 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:28.473702 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:28.473745 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:28.473761 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:28.473856 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:28.474061 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 01:18:28.474092 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":81,"threads_started":1}
I20260812 01:18:28.475019 25876 catalog_manager.cc:1347] Generated new cluster ID: 6408ef5b4dcf413ba44b1affc7bc70fe
I20260812 01:18:28.475067 25876 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:28.475453 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:28.480471 25858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:28.477115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:42053 (local address 127.0.0.1:34647)
0812 01:18:28.477156 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:28.477158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:28.477165 (+ 7us) server_negotiation.cc:407] Connection header received
0812 01:18:28.477234 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:28.477235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:28.477244 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:28.477293 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:28.477431 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:28.478107 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:28.479109 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:28.479432 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:28.479493 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:28.480214 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:28.480215 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:28.480215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:28.480219 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:28.480233 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:28.480237 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:28.480290 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:28.480389 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 01:18:28.480400 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":10,"server-negotiator.queue_time_us":23}
I20260812 01:18:28.483318 25876 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:28.483968 25876 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:28.489090 25876 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73489f935c5b4752995b258e010a3087: Generated new TSK 0
I20260812 01:18:28.489295 25876 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:28.496057 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 25729
W20260812 01:18:28.511461 25698 connection.cc:535] client connection to 127.0.0.1:34647 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34647): Connection reset by peer (error 104)
2026-08-12T01:18:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1621 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:28 dist-test-slave-rwrg krb5kdc[25906](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:28 dist-test-slave-rwrg krb5kdc[25906](info): set up 2 sockets
Aug 12 01:18:28 dist-test-slave-rwrg krb5kdc[25906](info): commencing operation
krb5kdc: starting...
W20260812 01:18:29.786515 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:29 dist-test-slave-rwrg krb5kdc[25906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:18:29.911360 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34487
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:29.993549 25926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:29.993754 25926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:29.993788 25926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:29.994907 25926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:29.994951 25926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:29.994966 25926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:29.994977 25926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:29.994989 25926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:29.996417 25926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34487
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:29.996696 25926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:29.996891 25926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:30.001713 25941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:30.001718 25939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:30.001989 25944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:30.001977 25926 server_base.cc:1034] running on GCE node
I20260812 01:18:30.002277 25926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:30.002534 25926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:30.003671 25926 hybrid_clock.cc:648] HybridClock initialized: now 1786497510003660 us; error 33 us; skew 500 ppm
Aug 12 01:18:30 dist-test-slave-rwrg krb5kdc[25906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497510, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:30.006224 25926 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:18:30.006724 25926 webserver.cc:460] Webserver started at http://127.0.0.1:33087/ using document root <none> and password file <none>
I20260812 01:18:30.006909 25926 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:30.006953 25926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:30.007043 25926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:30.008046 25926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "2bef1e72aa104695a47902e4a2f3d4fe"
format_stamp: "Formatted at 2026-08-12 01:18:30 on dist-test-slave-rwrg"
server_key: "b2e2b9473e9f379f0d2355a959aa5ed1"
server_key_iv: "a3ed6ed2221d850e053aaec885bf475c"
server_key_version: "encryptionkey@0"
I20260812 01:18:30.008373 25926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "2bef1e72aa104695a47902e4a2f3d4fe"
format_stamp: "Formatted at 2026-08-12 01:18:30 on dist-test-slave-rwrg"
server_key: "b2e2b9473e9f379f0d2355a959aa5ed1"
server_key_iv: "a3ed6ed2221d850e053aaec885bf475c"
server_key_version: "encryptionkey@0"
I20260812 01:18:30.009819 25926 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:18:30.010637 25957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:30.010869 25926 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:18:30.010967 25926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "2bef1e72aa104695a47902e4a2f3d4fe"
format_stamp: "Formatted at 2026-08-12 01:18:30 on dist-test-slave-rwrg"
server_key: "b2e2b9473e9f379f0d2355a959aa5ed1"
server_key_iv: "a3ed6ed2221d850e053aaec885bf475c"
server_key_version: "encryptionkey@0"
I20260812 01:18:30.011030 25926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:30.014453 25926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:30.016438 25926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:30.016736 25926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:30.021019 25926 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34487
I20260812 01:18:30.021044 26040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34487 every 8 connection(s)
I20260812 01:18:30.021410 25926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:30.022456 26041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:30.024837 26041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe: Bootstrap starting.
I20260812 01:18:30.025477 26041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:30.025774 26041 log.cc:824] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:30.026438 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 25926
I20260812 01:18:30.026523 26041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe: No bootstrap required, opened a new log
I20260812 01:18:30.026614 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:30.026800 18142 external_mini_cluster.cc:1428] Setting key 98c8936d14b51db527097f83738074fb
I20260812 01:18:30.028580 26041 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bef1e72aa104695a47902e4a2f3d4fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34487 } }
I20260812 01:18:30.028784 26041 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:30.028869 26041 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bef1e72aa104695a47902e4a2f3d4fe, State: Initialized, Role: FOLLOWER
I20260812 01:18:30.029062 26041 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bef1e72aa104695a47902e4a2f3d4fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34487 } }
I20260812 01:18:30.029168 26041 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:30.029209 26041 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:30.029270 26041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:30.029814 26048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:30.027340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:37351 (local address 127.0.0.1:34487)
0812 01:18:30.027513 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:30.027520 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:30.027544 (+ 24us) server_negotiation.cc:407] Connection header received
0812 01:18:30.028531 (+ 987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:30.028541 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:30.028579 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:30.028696 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:30.029401 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:30.029404 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:30.029404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:30.029409 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:30.029447 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:30.029457 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:30.029530 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:30.029609 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 01:18:30.029654 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":78,"threads_started":1}
I20260812 01:18:30.030548 26041 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bef1e72aa104695a47902e4a2f3d4fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34487 } }
I20260812 01:18:30.030682 26041 leader_election.cc:302] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2bef1e72aa104695a47902e4a2f3d4fe; no voters:
I20260812 01:18:30.030792 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:30.030869 26041 leader_election.cc:288] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:30.030894 26055 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:30.031080 26055 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [term 1 LEADER]: Becoming Leader. State: Replica: 2bef1e72aa104695a47902e4a2f3d4fe, State: Running, Role: LEADER
I20260812 01:18:30.031212 26041 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:30.031213 26055 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bef1e72aa104695a47902e4a2f3d4fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34487 } }
I20260812 01:18:30.033193 26061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2bef1e72aa104695a47902e4a2f3d4fe. Latest consensus state: current_term: 1 leader_uuid: "2bef1e72aa104695a47902e4a2f3d4fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bef1e72aa104695a47902e4a2f3d4fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34487 } } }
I20260812 01:18:30.033264 26058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2bef1e72aa104695a47902e4a2f3d4fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bef1e72aa104695a47902e4a2f3d4fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34487 } } }
I20260812 01:18:30.033504 26061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:30.033509 26058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:30.033864 26048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:30.032375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.237:46347 (local address 127.0.0.1:34487)
0812 01:18:30.032417 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:30.032419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:30.032613 (+ 194us) server_negotiation.cc:407] Connection header received
0812 01:18:30.032724 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:30.032725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:30.032731 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:30.032789 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:30.033602 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:30.033603 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:30.033603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:30.033608 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:30.033622 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:30.033626 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:30.033678 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:30.033765 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 01:18:30.033781 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 01:18:30.034173 26088 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:18:30.034247 26088 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:18:30.034344 26091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:30.034528 26091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:30.035943 26091 catalog_manager.cc:1347] Generated new cluster ID: 839636c9b52d433f918e44bbbd172594
I20260812 01:18:30.035995 26091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:30.047993 26091 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:30.048164 26091 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:30.052497 26091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2bef1e72aa104695a47902e4a2f3d4fe: Generated new TSK 0
I20260812 01:18:30.052721 26091 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:30.063133 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 25926
2026-08-12T01:18:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1561 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:30 dist-test-slave-rwrg krb5kdc[26102](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:30 dist-test-slave-rwrg krb5kdc[26102](info): set up 2 sockets
Aug 12 01:18:30 dist-test-slave-rwrg krb5kdc[26102](info): commencing operation
krb5kdc: starting...
W20260812 01:18:31.357124 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:31 dist-test-slave-rwrg krb5kdc[26102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:18:31.482765 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:46129
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:33237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:46129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:31.569109 26127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:31.569399 26127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:31.569447 26127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:31.570706 26127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:31.570779 26127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:31.570808 26127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:31.570839 26127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:31.570873 26127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:31.572655 26127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:33237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:46129
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:46129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:31.572950 26127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:31.573199 26127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:31.578536 26135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:31.578547 26141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:31.578552 26144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:31.578711 26127 server_base.cc:1034] running on GCE node
I20260812 01:18:31.579018 26127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:31.579295 26127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:31.580533 26127 hybrid_clock.cc:648] HybridClock initialized: now 1786497511580516 us; error 30 us; skew 500 ppm
Aug 12 01:18:31 dist-test-slave-rwrg krb5kdc[26102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497511, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:31.582998 26127 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:18:31.583412 26127 webserver.cc:460] Webserver started at http://127.17.183.190:36197/ using document root <none> and password file <none>
I20260812 01:18:31.583627 26127 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:31.583695 26127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:31.583844 26127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:31.584946 26127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "62ef23d4d2e646f89e8914c02336c31a"
format_stamp: "Formatted at 2026-08-12 01:18:31 on dist-test-slave-rwrg"
server_key: "7a738710eec43c938b618dbbc9752168"
server_key_iv: "81b71c86cb71b99de3dd63051c4191db"
server_key_version: "encryptionkey@0"
I20260812 01:18:31.585304 26127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "62ef23d4d2e646f89e8914c02336c31a"
format_stamp: "Formatted at 2026-08-12 01:18:31 on dist-test-slave-rwrg"
server_key: "7a738710eec43c938b618dbbc9752168"
server_key_iv: "81b71c86cb71b99de3dd63051c4191db"
server_key_version: "encryptionkey@0"
I20260812 01:18:31.586696 26127 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:18:31.587435 26154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:31.587679 26127 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:31.587806 26127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "62ef23d4d2e646f89e8914c02336c31a"
format_stamp: "Formatted at 2026-08-12 01:18:31 on dist-test-slave-rwrg"
server_key: "7a738710eec43c938b618dbbc9752168"
server_key_iv: "81b71c86cb71b99de3dd63051c4191db"
server_key_version: "encryptionkey@0"
I20260812 01:18:31.587890 26127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:31.611470 26127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:31.613376 26127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:31.613535 26127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:31.617477 26127 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:46129
I20260812 01:18:31.617515 26240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:46129 every 8 connection(s)
I20260812 01:18:31.617871 26127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:31.618125 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 26127
I20260812 01:18:31.618266 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:31.618517 18142 external_mini_cluster.cc:1428] Setting key 5059ad3ac4ee16b9a14ba791e35f0b42
I20260812 01:18:31.619007 26242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:31.622210 26242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a: Bootstrap starting.
I20260812 01:18:31.622929 26242 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:31.623328 26242 log.cc:824] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:31.624158 26242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a: No bootstrap required, opened a new log
Aug 12 01:18:31 dist-test-slave-rwrg krb5kdc[26102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:31.626608 26242 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ef23d4d2e646f89e8914c02336c31a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46129 } }
I20260812 01:18:31.626803 26242 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:31.626850 26242 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ef23d4d2e646f89e8914c02336c31a, State: Initialized, Role: FOLLOWER
I20260812 01:18:31.626994 26242 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ef23d4d2e646f89e8914c02336c31a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46129 } }
I20260812 01:18:31.627085 26242 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:31.627133 26242 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:31.627182 26242 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:31.627915 26242 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ef23d4d2e646f89e8914c02336c31a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46129 } }
I20260812 01:18:31.628043 26242 leader_election.cc:302] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62ef23d4d2e646f89e8914c02336c31a; no voters:
I20260812 01:18:31.628252 26242 leader_election.cc:288] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:31.628281 26251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:31.628469 26251 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [term 1 LEADER]: Becoming Leader. State: Replica: 62ef23d4d2e646f89e8914c02336c31a, State: Running, Role: LEADER
I20260812 01:18:31.628615 26242 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:31.628677 26251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ef23d4d2e646f89e8914c02336c31a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46129 } }
I20260812 01:18:31.629020 26251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62ef23d4d2e646f89e8914c02336c31a. Latest consensus state: current_term: 1 leader_uuid: "62ef23d4d2e646f89e8914c02336c31a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ef23d4d2e646f89e8914c02336c31a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46129 } } }
I20260812 01:18:31.629169 26251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:31.629429 26252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62ef23d4d2e646f89e8914c02336c31a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ef23d4d2e646f89e8914c02336c31a" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 46129 } } }
I20260812 01:18:31.629478 26265 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:31.629522 26252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:31.629905 26249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:31.619053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42905 (local address 127.17.183.190:46129)
0812 01:18:31.619221 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:31.619228 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:31.619253 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:18:31.619664 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:31.619670 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:31.619713 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:31.619818 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:31.620609 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:31.621437 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:31.622530 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:31.622929 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:31.623010 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:31.625727 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:31.625733 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:31.625734 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:31.625761 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:31.627721 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:31.628137 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:31.628140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:31.628140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:31.628249 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:31.628571 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:31.628572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:31.628573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:31.628870 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:31.628996 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:31.629592 (+ 596us) server_negotiation.cc:299] Negotiation successful
0812 01:18:31.629698 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":82,"threads_started":1}
I20260812 01:18:31.629989 26265 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:31.631340 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:31.631949 26265 catalog_manager.cc:1347] Generated new cluster ID: c05db86fc38e4c77bc09f2d3d95cb5fa
I20260812 01:18:31.632045 26265 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:31.637946 26265 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:31.638656 26265 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:31.640719 26249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:31.632745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40515 (local address 127.17.183.190:46129)
0812 01:18:31.632784 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:31.632786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:31.632901 (+ 115us) server_negotiation.cc:407] Connection header received
0812 01:18:31.632932 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:31.632933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:31.632943 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:31.633000 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:31.633600 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:31.634329 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:31.635263 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:31.636234 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:31.636315 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:31.637706 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:31.637708 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:31.637708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:31.637727 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:31.639316 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:31.639767 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:31.639768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:31.639768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:31.639821 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:31.640049 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:31.640049 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:31.640050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:31.640183 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:31.640289 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:31.640467 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 01:18:31.640551 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 01:18:31.642489 26265 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62ef23d4d2e646f89e8914c02336c31a: Generated new TSK 0
I20260812 01:18:31.642665 26265 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:31.646049 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 26127
W20260812 01:18:31.671232 26096 connection.cc:535] client connection to 127.17.183.190:46129 recv error: Network error: failed to read from TLS socket (remote: 127.17.183.190:46129): Connection reset by peer (error 104)
2026-08-12T01:18:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1598 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:31 dist-test-slave-rwrg krb5kdc[26300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:31 dist-test-slave-rwrg krb5kdc[26300](info): set up 2 sockets
Aug 12 01:18:31 dist-test-slave-rwrg krb5kdc[26300](info): commencing operation
krb5kdc: starting...
W20260812 01:18:32.968592 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:33 dist-test-slave-rwrg krb5kdc[26300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:18:33.097440 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:35141
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:37603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:35141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:33.193192 26330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:33.193507 26330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:33.193544 26330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:33.195626 26330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:33.195712 26330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:33.195747 26330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:33.195799 26330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:33.195832 26330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:33.198403 26330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:37603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:35141
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:35141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:33.198699 26330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:33.198925 26330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:33.204876 26344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:33.204854 26339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:33.204852 26341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:33.205363 26330 server_base.cc:1034] running on GCE node
I20260812 01:18:33.205681 26330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:33.206069 26330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:33.207321 26330 hybrid_clock.cc:648] HybridClock initialized: now 1786497513207297 us; error 37 us; skew 500 ppm
Aug 12 01:18:33 dist-test-slave-rwrg krb5kdc[26300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497513, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:33.209988 26330 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:18:33.210506 26330 webserver.cc:460] Webserver started at http://127.17.183.190:35749/ using document root <none> and password file <none>
I20260812 01:18:33.210781 26330 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:33.210827 26330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:33.210963 26330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:33.212113 26330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "3576cde9504e4dabaf34cf34b63362bb"
format_stamp: "Formatted at 2026-08-12 01:18:33 on dist-test-slave-rwrg"
server_key: "01aeba676be1a3a4566ba0efdaaa103d"
server_key_iv: "2f2b4f5d202b91838c90be5249b0d876"
server_key_version: "encryptionkey@0"
I20260812 01:18:33.212481 26330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "3576cde9504e4dabaf34cf34b63362bb"
format_stamp: "Formatted at 2026-08-12 01:18:33 on dist-test-slave-rwrg"
server_key: "01aeba676be1a3a4566ba0efdaaa103d"
server_key_iv: "2f2b4f5d202b91838c90be5249b0d876"
server_key_version: "encryptionkey@0"
I20260812 01:18:33.214103 26330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:18:33.215004 26353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:33.215186 26330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:33.215279 26330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "3576cde9504e4dabaf34cf34b63362bb"
format_stamp: "Formatted at 2026-08-12 01:18:33 on dist-test-slave-rwrg"
server_key: "01aeba676be1a3a4566ba0efdaaa103d"
server_key_iv: "2f2b4f5d202b91838c90be5249b0d876"
server_key_version: "encryptionkey@0"
I20260812 01:18:33.215376 26330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:33.235343 26330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:33.237756 26330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:33.237969 26330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:33.242187 26330 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:35141
I20260812 01:18:33.242234 26448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:35141 every 8 connection(s)
I20260812 01:18:33.242614 26330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:33.243078 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 26330
I20260812 01:18:33.243214 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:33.243422 18142 external_mini_cluster.cc:1428] Setting key 2b84904d41cb898e7c418ac5f0803a17
I20260812 01:18:33.243621 26452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:33.246990 26452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb: Bootstrap starting.
I20260812 01:18:33.247648 26452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:33.248010 26452 log.cc:824] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:33.248848 26452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb: No bootstrap required, opened a new log
I20260812 01:18:33.249152 26457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:33.243964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42401 (local address 127.17.183.190:35141)
0812 01:18:33.244172 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:33.244188 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:33.244214 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:18:33.244823 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:33.244830 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:33.244879 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:33.244993 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:33.245230 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:33.246113 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:33.247189 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:33.247581 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:33.247661 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:33.248406 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:33.248411 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:33.248411 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:33.248654 (+ 243us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:33.248685 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:33.248697 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:33.248767 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:33.248923 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 01:18:33.248955 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":114,"threads_started":1}
I20260812 01:18:33.250386 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:33.251138 26452 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576cde9504e4dabaf34cf34b63362bb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35141 } }
I20260812 01:18:33.251271 26452 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:33.251295 26452 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3576cde9504e4dabaf34cf34b63362bb, State: Initialized, Role: FOLLOWER
I20260812 01:18:33.251415 26452 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576cde9504e4dabaf34cf34b63362bb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35141 } }
I20260812 01:18:33.251533 26452 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:33.251623 26452 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:33.251689 26452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:33.252408 26452 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576cde9504e4dabaf34cf34b63362bb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35141 } }
I20260812 01:18:33.252563 26452 leader_election.cc:302] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3576cde9504e4dabaf34cf34b63362bb; no voters:
I20260812 01:18:33.252735 26452 leader_election.cc:288] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:33.252765 26467 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:33.252879 26467 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [term 1 LEADER]: Becoming Leader. State: Replica: 3576cde9504e4dabaf34cf34b63362bb, State: Running, Role: LEADER
I20260812 01:18:33.253000 26452 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:33.253022 26467 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576cde9504e4dabaf34cf34b63362bb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35141 } }
I20260812 01:18:33.253418 26467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3576cde9504e4dabaf34cf34b63362bb. Latest consensus state: current_term: 1 leader_uuid: "3576cde9504e4dabaf34cf34b63362bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576cde9504e4dabaf34cf34b63362bb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35141 } } }
I20260812 01:18:33.253430 26470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3576cde9504e4dabaf34cf34b63362bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576cde9504e4dabaf34cf34b63362bb" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 35141 } } }
I20260812 01:18:33.253556 26467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:33.253845 26470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:33.254408 26485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:33.255292 26485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:33.256039 26457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:33.252128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52139 (local address 127.17.183.190:35141)
0812 01:18:33.252172 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:33.252173 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:33.252288 (+ 115us) server_negotiation.cc:407] Connection header received
0812 01:18:33.252373 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:33.252374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:33.252384 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:33.252466 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:33.252709 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:33.253481 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:33.254611 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:33.254879 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:33.254948 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:33.255751 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:33.255752 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:33.255753 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:33.255758 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:33.255773 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:33.255777 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:33.255841 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:33.255926 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 01:18:33.255938 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 01:18:33.256817 26485 catalog_manager.cc:1347] Generated new cluster ID: ba6037c8c64e45fcb8af69b0a41ed2ff
I20260812 01:18:33.256873 26485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:33.267128 26485 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:33.267756 26485 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:33.270303 26485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3576cde9504e4dabaf34cf34b63362bb: Generated new TSK 0
I20260812 01:18:33.270473 26485 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:33.274655 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 26330
W20260812 01:18:33.291895 26296 connection.cc:535] client connection to 127.17.183.190:35141 recv error: Network error: failed to read from TLS socket (remote: 127.17.183.190:35141): Connection reset by peer (error 104)
2026-08-12T01:18:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1621 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:33 dist-test-slave-rwrg krb5kdc[26505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:33 dist-test-slave-rwrg krb5kdc[26505](info): set up 2 sockets
Aug 12 01:18:33 dist-test-slave-rwrg krb5kdc[26505](info): commencing operation
krb5kdc: starting...
W20260812 01:18:34.582058 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:34 dist-test-slave-rwrg krb5kdc[26505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:18:34.703279 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33541
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:33907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:33541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:34.785953 26524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:34.786144 26524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:34.786166 26524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:34.787225 26524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:34.787267 26524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:34.787281 26524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:34.787303 26524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:34.787317 26524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:34.788846 26524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:33907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:33541
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:33541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:34.789031 26524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:34.789206 26524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:34.794137 26539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:34.794167 26532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:34.794265 26524 server_base.cc:1034] running on GCE node
W20260812 01:18:34.794149 26535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:34.794670 26524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:34.795002 26524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:34.796212 26524 hybrid_clock.cc:648] HybridClock initialized: now 1786497514796185 us; error 42 us; skew 500 ppm
Aug 12 01:18:34 dist-test-slave-rwrg krb5kdc[26505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497514, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:34.798756 26524 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:18:34.799171 26524 webserver.cc:460] Webserver started at http://127.17.183.190:39313/ using document root <none> and password file <none>
I20260812 01:18:34.799408 26524 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:34.799453 26524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:34.799638 26524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:34.800760 26524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "67b5ffef681e4d8d9c9518b3171ce7c8"
format_stamp: "Formatted at 2026-08-12 01:18:34 on dist-test-slave-rwrg"
server_key: "b3a76aea9cdcf0868dbb783836085eaf"
server_key_iv: "75d4f6f80a55d2ccc7a7648498a0d362"
server_key_version: "encryptionkey@0"
I20260812 01:18:34.801115 26524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "67b5ffef681e4d8d9c9518b3171ce7c8"
format_stamp: "Formatted at 2026-08-12 01:18:34 on dist-test-slave-rwrg"
server_key: "b3a76aea9cdcf0868dbb783836085eaf"
server_key_iv: "75d4f6f80a55d2ccc7a7648498a0d362"
server_key_version: "encryptionkey@0"
I20260812 01:18:34.802392 26524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:18:34.803139 26552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:34.803449 26524 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:34.803541 26524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "67b5ffef681e4d8d9c9518b3171ce7c8"
format_stamp: "Formatted at 2026-08-12 01:18:34 on dist-test-slave-rwrg"
server_key: "b3a76aea9cdcf0868dbb783836085eaf"
server_key_iv: "75d4f6f80a55d2ccc7a7648498a0d362"
server_key_version: "encryptionkey@0"
I20260812 01:18:34.803596 26524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:34.806756 26524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:34.809077 26524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:34.809186 26524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:34.813058 26524 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:33541
I20260812 01:18:34.813158 26638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:33541 every 8 connection(s)
I20260812 01:18:34.813472 26524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:34.814486 26639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:34.816747 26639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8: Bootstrap starting.
I20260812 01:18:34.817272 26639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:34.817504 26639 log.cc:824] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:34.817839 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 26524
I20260812 01:18:34.817979 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:34.818188 18142 external_mini_cluster.cc:1428] Setting key 998d40c0b6f6daaca79152121c227485
I20260812 01:18:34.818269 26639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8: No bootstrap required, opened a new log
I20260812 01:18:34.820070 26639 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b5ffef681e4d8d9c9518b3171ce7c8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33541 } }
I20260812 01:18:34.820222 26639 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:34.820288 26639 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67b5ffef681e4d8d9c9518b3171ce7c8, State: Initialized, Role: FOLLOWER
I20260812 01:18:34.820475 26639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b5ffef681e4d8d9c9518b3171ce7c8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33541 } }
I20260812 01:18:34.820617 26639 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:34.820657 26639 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:34.820714 26639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:34.821355 26643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:34.818689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52707 (local address 127.17.183.190:33541)
0812 01:18:34.818917 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:34.818927 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:34.818960 (+ 33us) server_negotiation.cc:407] Connection header received
0812 01:18:34.820054 (+ 1094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:34.820060 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:34.820087 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:34.820226 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:34.820908 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:34.820912 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:34.820912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:34.820916 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:34.820966 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:34.820976 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:34.821053 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:34.821144 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 01:18:34.821183 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":110,"threads_started":1}
I20260812 01:18:34.821827 26639 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b5ffef681e4d8d9c9518b3171ce7c8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33541 } }
I20260812 01:18:34.821949 26639 leader_election.cc:302] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67b5ffef681e4d8d9c9518b3171ce7c8; no voters:
I20260812 01:18:34.822130 26639 leader_election.cc:288] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:34.822180 26644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:34.822283 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:34.822345 26644 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [term 1 LEADER]: Becoming Leader. State: Replica: 67b5ffef681e4d8d9c9518b3171ce7c8, State: Running, Role: LEADER
I20260812 01:18:34.822425 26644 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b5ffef681e4d8d9c9518b3171ce7c8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33541 } }
I20260812 01:18:34.822423 26639 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:34.822751 26644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67b5ffef681e4d8d9c9518b3171ce7c8. Latest consensus state: current_term: 1 leader_uuid: "67b5ffef681e4d8d9c9518b3171ce7c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b5ffef681e4d8d9c9518b3171ce7c8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33541 } } }
I20260812 01:18:34.822834 26644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:34.822984 26649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67b5ffef681e4d8d9c9518b3171ce7c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b5ffef681e4d8d9c9518b3171ce7c8" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 33541 } } }
I20260812 01:18:34.823052 26649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:34.823194 26653 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:34.823907 26653 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:34.825865 26653 catalog_manager.cc:1347] Generated new cluster ID: 4a545efa34774ef39635d1afe3a9b9f6
I20260812 01:18:34.825932 26653 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:34.826104 26643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:34.824691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58105 (local address 127.17.183.190:33541)
0812 01:18:34.824722 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:34.824724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:34.824898 (+ 174us) server_negotiation.cc:407] Connection header received
0812 01:18:34.825109 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:34.825110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:34.825130 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:34.825199 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:34.825799 (+ 600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:34.825800 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:34.825801 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:34.825805 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:34.825819 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:34.825823 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:34.825880 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:34.826021 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 01:18:34.826033 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 01:18:34.849136 26653 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:34.849326 26653 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:34.853513 26653 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67b5ffef681e4d8d9c9518b3171ce7c8: Generated new TSK 0
I20260812 01:18:34.853688 26653 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:34.862686 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 26524
2026-08-12T01:18:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1583 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:34 dist-test-slave-rwrg krb5kdc[26693](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:34 dist-test-slave-rwrg krb5kdc[26693](info): set up 2 sockets
Aug 12 01:18:34 dist-test-slave-rwrg krb5kdc[26693](info): commencing operation
krb5kdc: starting...
W20260812 01:18:36.178258 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:36 dist-test-slave-rwrg krb5kdc[26693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:18:36.303515 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:39851
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:41873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:39851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:36.385986 26714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:36.386238 26714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:36.386281 26714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:36.387431 26714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:36.387501 26714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:36.387526 26714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:36.387554 26714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:36.387589 26714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:36.389175 26714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:41873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:39851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:39851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:36.389493 26714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:36.389719 26714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:36.394575 26728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:36.394670 26731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:36.394591 26727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:36.394850 26714 server_base.cc:1034] running on GCE node
I20260812 01:18:36.395174 26714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:36.395457 26714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:36.396615 26714 hybrid_clock.cc:648] HybridClock initialized: now 1786497516396601 us; error 49 us; skew 500 ppm
Aug 12 01:18:36 dist-test-slave-rwrg krb5kdc[26693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497516, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:36.398983 26714 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:18:36.399458 26714 webserver.cc:460] Webserver started at http://127.17.183.190:34969/ using document root <none> and password file <none>
I20260812 01:18:36.399686 26714 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:36.399752 26714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:36.399906 26714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:36.401126 26714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "161afd3a81744a9f8cfbcde0c95205be"
format_stamp: "Formatted at 2026-08-12 01:18:36 on dist-test-slave-rwrg"
server_key: "37ffd911980bac05e285c055687f3d55"
server_key_iv: "fd2180167cb25caa60d7a93586606cd8"
server_key_version: "encryptionkey@0"
I20260812 01:18:36.401528 26714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "161afd3a81744a9f8cfbcde0c95205be"
format_stamp: "Formatted at 2026-08-12 01:18:36 on dist-test-slave-rwrg"
server_key: "37ffd911980bac05e285c055687f3d55"
server_key_iv: "fd2180167cb25caa60d7a93586606cd8"
server_key_version: "encryptionkey@0"
I20260812 01:18:36.402963 26714 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 01:18:36.403713 26741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:36.403931 26714 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:36.404066 26714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "161afd3a81744a9f8cfbcde0c95205be"
format_stamp: "Formatted at 2026-08-12 01:18:36 on dist-test-slave-rwrg"
server_key: "37ffd911980bac05e285c055687f3d55"
server_key_iv: "fd2180167cb25caa60d7a93586606cd8"
server_key_version: "encryptionkey@0"
I20260812 01:18:36.404145 26714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:36.416793 26714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:36.418642 26714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:36.418797 26714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:36.422935 26714 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:39851
I20260812 01:18:36.423009 26822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:39851 every 8 connection(s)
I20260812 01:18:36.423332 26714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:36.424187 26823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:36.426527 26823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be: Bootstrap starting.
I20260812 01:18:36.427116 26823 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:36.427374 26823 log.cc:824] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:36.428045 26823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be: No bootstrap required, opened a new log
I20260812 01:18:36.428704 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 26714
I20260812 01:18:36.428846 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:36.429044 18142 external_mini_cluster.cc:1428] Setting key 1dd5f33bb221862fc8afea7f4255177f
I20260812 01:18:36.430281 26823 raft_consensus.cc:348] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "161afd3a81744a9f8cfbcde0c95205be" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39851 } }
I20260812 01:18:36.430457 26823 raft_consensus.cc:374] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:36.430541 26823 raft_consensus.cc:729] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161afd3a81744a9f8cfbcde0c95205be, State: Initialized, Role: FOLLOWER
I20260812 01:18:36.430691 26823 consensus_queue.cc:260] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "161afd3a81744a9f8cfbcde0c95205be" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39851 } }
I20260812 01:18:36.430796 26823 raft_consensus.cc:388] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:36.430832 26823 raft_consensus.cc:482] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:36.430886 26823 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:36.431864 26823 raft_consensus.cc:504] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "161afd3a81744a9f8cfbcde0c95205be" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39851 } }
I20260812 01:18:36.431958 26823 leader_election.cc:302] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 161afd3a81744a9f8cfbcde0c95205be; no voters:
I20260812 01:18:36.432147 26823 leader_election.cc:288] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:36.432186 26829 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:36.432334 26829 raft_consensus.cc:686] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [term 1 LEADER]: Becoming Leader. State: Replica: 161afd3a81744a9f8cfbcde0c95205be, State: Running, Role: LEADER
I20260812 01:18:36.432422 26823 sys_catalog.cc:564] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:36.432462 26829 consensus_queue.cc:237] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "161afd3a81744a9f8cfbcde0c95205be" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39851 } }
I20260812 01:18:36.432965 26832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "161afd3a81744a9f8cfbcde0c95205be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "161afd3a81744a9f8cfbcde0c95205be" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39851 } } }
I20260812 01:18:36.433041 26832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:36.433250 26833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 161afd3a81744a9f8cfbcde0c95205be. Latest consensus state: current_term: 1 leader_uuid: "161afd3a81744a9f8cfbcde0c95205be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "161afd3a81744a9f8cfbcde0c95205be" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 39851 } } }
I20260812 01:18:36.433342 26833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:36.433629 26842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:36.434163 26842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:36.436014 26842 catalog_manager.cc:1347] Generated new cluster ID: 2a17326a5f604f7c81d3e8a1b842492d
I20260812 01:18:36.436064 26842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 01:18:36 dist-test-slave-rwrg krb5kdc[26693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:36.440764 26828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:36.429584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45949 (local address 127.17.183.190:39851)
0812 01:18:36.429759 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:36.429767 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:36.429795 (+ 28us) server_negotiation.cc:407] Connection header received
0812 01:18:36.430259 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:36.430265 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:36.430310 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:36.430420 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:36.431341 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:36.432438 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:36.433550 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:36.434164 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:36.434594 (+ 430us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:36.437092 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:36.437096 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:36.437096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:36.437108 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:36.439036 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:36.439460 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:36.439463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:36.439463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:36.439593 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:36.439823 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:36.439824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:36.439824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:36.440098 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:36.440247 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:36.440374 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 01:18:36.440536 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":89,"threads_started":1}
I20260812 01:18:36.441756 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:36.442210 26842 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:36.442648 26842 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:36.449156 26842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 161afd3a81744a9f8cfbcde0c95205be: Generated new TSK 0
I20260812 01:18:36.449347 26842 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:36.451728 26828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:36.444779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59163 (local address 127.17.183.190:39851)
0812 01:18:36.444827 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:36.444828 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:36.444885 (+ 57us) server_negotiation.cc:407] Connection header received
0812 01:18:36.444959 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:36.444960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:36.444970 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:36.445013 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:36.445639 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:36.446367 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:36.447420 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:36.447739 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:36.447792 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:36.449213 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:36.449214 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:36.449214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:36.449223 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:36.450688 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:36.451066 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:36.451067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:36.451067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:36.451115 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:36.451324 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:36.451325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:36.451325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:36.451412 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:36.451490 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:36.451619 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 01:18:36.451675 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 01:18:36.453531 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 26714
2026-08-12T01:18:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1597 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:36 dist-test-slave-rwrg krb5kdc[26869](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:36 dist-test-slave-rwrg krb5kdc[26869](info): set up 2 sockets
Aug 12 01:18:36 dist-test-slave-rwrg krb5kdc[26869](info): commencing operation
krb5kdc: starting...
W20260812 01:18:37.752401 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:37 dist-test-slave-rwrg krb5kdc[26869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:18:37.875200 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:41421
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:41421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:37.958927 26893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:37.959179 26893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:37.959219 26893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:37.960358 26893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:37.960426 26893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:37.960453 26893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:37.960484 26893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:37.960528 26893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:37.962077 26893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:41421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:41421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:37.962388 26893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:37.962620 26893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:37.967500 26899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:37.967609 26901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:37.967512 26898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:37.967836 26893 server_base.cc:1034] running on GCE node
I20260812 01:18:37.968117 26893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:37.968420 26893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:37.969599 26893 hybrid_clock.cc:648] HybridClock initialized: now 1786497517969573 us; error 41 us; skew 500 ppm
Aug 12 01:18:37 dist-test-slave-rwrg krb5kdc[26869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497517, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:37.972345 26893 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:18:37.973057 26893 webserver.cc:460] Webserver started at http://127.17.183.190:46865/ using document root <none> and password file <none>
I20260812 01:18:37.973506 26893 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:37.973628 26893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:37.973783 26893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:37.975039 26893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "9a1728d5673f47908ee91df20ddb96f1"
format_stamp: "Formatted at 2026-08-12 01:18:37 on dist-test-slave-rwrg"
server_key: "4d4c89b445fa632448b345fb61e52098"
server_key_iv: "7d0fb8453b315e63af96373055cd04cb"
server_key_version: "encryptionkey@0"
I20260812 01:18:37.975430 26893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "9a1728d5673f47908ee91df20ddb96f1"
format_stamp: "Formatted at 2026-08-12 01:18:37 on dist-test-slave-rwrg"
server_key: "4d4c89b445fa632448b345fb61e52098"
server_key_iv: "7d0fb8453b315e63af96373055cd04cb"
server_key_version: "encryptionkey@0"
I20260812 01:18:37.976821 26893 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:37.977648 26913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:37.977831 26893 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:37.977947 26893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "9a1728d5673f47908ee91df20ddb96f1"
format_stamp: "Formatted at 2026-08-12 01:18:37 on dist-test-slave-rwrg"
server_key: "4d4c89b445fa632448b345fb61e52098"
server_key_iv: "7d0fb8453b315e63af96373055cd04cb"
server_key_version: "encryptionkey@0"
I20260812 01:18:37.978026 26893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:38.002854 26893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:38.005297 26893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:38.005465 26893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:38.009714 26893 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:41421
I20260812 01:18:38.009754 26998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:41421 every 8 connection(s)
I20260812 01:18:38.010142 26893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:38.010479 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 26893
I20260812 01:18:38.010618 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:38.010841 18142 external_mini_cluster.cc:1428] Setting key 6766a39e6fd0490e62996fd14bcf0ab2
I20260812 01:18:38.011262 26999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:38.014554 26999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1: Bootstrap starting.
I20260812 01:18:38.015327 26999 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:38.015618 26999 log.cc:824] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:38.016453 26999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1: No bootstrap required, opened a new log
I20260812 01:18:38.016528 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:38.011386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35099 (local address 127.17.183.190:41421)
0812 01:18:38.011579 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:38.011587 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:38.011612 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:18:38.012035 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:38.012041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:38.012083 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:38.012198 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:38.012444 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:38.013321 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:38.014438 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:38.014916 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:38.015004 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:38.015728 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:38.015732 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:38.015733 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:38.015935 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:38.015965 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:38.015977 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:38.016028 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:38.016182 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 01:18:38.016253 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":99,"threads_started":1}
I20260812 01:18:38.017808 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:38.019677 26999 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a1728d5673f47908ee91df20ddb96f1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 41421 } }
I20260812 01:18:38.019886 26999 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:38.019942 26999 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a1728d5673f47908ee91df20ddb96f1, State: Initialized, Role: FOLLOWER
I20260812 01:18:38.020138 26999 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a1728d5673f47908ee91df20ddb96f1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 41421 } }
I20260812 01:18:38.020236 26999 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:38.020262 26999 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:38.020341 26999 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:38.021018 26999 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a1728d5673f47908ee91df20ddb96f1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 41421 } }
I20260812 01:18:38.021157 26999 leader_election.cc:302] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a1728d5673f47908ee91df20ddb96f1; no voters:
I20260812 01:18:38.021370 26999 leader_election.cc:288] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:38.021404 27016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:38.021548 27016 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [term 1 LEADER]: Becoming Leader. State: Replica: 9a1728d5673f47908ee91df20ddb96f1, State: Running, Role: LEADER
I20260812 01:18:38.021663 26999 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:38.021703 27016 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a1728d5673f47908ee91df20ddb96f1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 41421 } }
I20260812 01:18:38.022133 27016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a1728d5673f47908ee91df20ddb96f1. Latest consensus state: current_term: 1 leader_uuid: "9a1728d5673f47908ee91df20ddb96f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a1728d5673f47908ee91df20ddb96f1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 41421 } } }
I20260812 01:18:38.022300 27016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:38.022173 27019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a1728d5673f47908ee91df20ddb96f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a1728d5673f47908ee91df20ddb96f1" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 41421 } } }
I20260812 01:18:38.022643 27033 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:38.022681 27019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:38.022981 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:38.019608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37495 (local address 127.17.183.190:41421)
0812 01:18:38.019649 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:38.019651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:38.019811 (+ 160us) server_negotiation.cc:407] Connection header received
0812 01:18:38.019893 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:38.019894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:38.019906 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:38.019971 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:38.020154 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:38.020820 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:38.021733 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:38.022008 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:38.022086 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:38.022742 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:38.022744 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:38.022744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:38.022748 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:38.022761 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:38.022765 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:38.022809 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:38.022884 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 01:18:38.022906 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 01:18:38.023293 27033 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:38.024746 27046 mvcc.cc:205] Tried to move back new op lower bound from 7317493833827254272 to 7317493833817583616. Current Snapshot: MvccSnapshot[applied={T|T < 7317493833827254272}]
I20260812 01:18:38.025296 27033 catalog_manager.cc:1347] Generated new cluster ID: eeb64706750d4dae90507ed2ff3cc653
I20260812 01:18:38.025357 27033 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:38.049818 27033 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:38.050422 27033 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:38.059103 27033 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a1728d5673f47908ee91df20ddb96f1: Generated new TSK 0
I20260812 01:18:38.059321 27033 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:38.063886 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 26893
2026-08-12T01:18:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1605 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:38 dist-test-slave-rwrg krb5kdc[27054](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:38 dist-test-slave-rwrg krb5kdc[27054](info): set up 2 sockets
Aug 12 01:18:38 dist-test-slave-rwrg krb5kdc[27054](info): commencing operation
krb5kdc: starting...
W20260812 01:18:39.377079 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:39 dist-test-slave-rwrg krb5kdc[27054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497519, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:18:39.500944 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:34347
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:34347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:39.583501 27085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:39.583709 27085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:39.583731 27085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:39.584911 27085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:39.584949 27085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:39.584964 27085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:39.584975 27085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:39.585031 27085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:39.586508 27085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:34347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:34347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:39.586771 27085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:39.587003 27085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:39.592053 27093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:39.592053 27094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:39.592082 27097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:39.592082 27085 server_base.cc:1034] running on GCE node
I20260812 01:18:39.592612 27085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:39.592864 27085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:39.594004 27085 hybrid_clock.cc:648] HybridClock initialized: now 1786497519593996 us; error 33 us; skew 500 ppm
Aug 12 01:18:39 dist-test-slave-rwrg krb5kdc[27054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497519, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:39.600692 27085 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:18:39.601251 27085 webserver.cc:460] Webserver started at http://127.17.183.190:37673/ using document root <none> and password file <none>
I20260812 01:18:39.601509 27085 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:39.601560 27085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:39.601724 27085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:39.602774 27085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "09d0d7ef4b9042f39c5b56850503a31c"
format_stamp: "Formatted at 2026-08-12 01:18:39 on dist-test-slave-rwrg"
server_key: "cda99759435cc74e8936755ceb8eb4d3"
server_key_iv: "f4c6ac56734735891f5a97266c109192"
server_key_version: "encryptionkey@0"
I20260812 01:18:39.603161 27085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "09d0d7ef4b9042f39c5b56850503a31c"
format_stamp: "Formatted at 2026-08-12 01:18:39 on dist-test-slave-rwrg"
server_key: "cda99759435cc74e8936755ceb8eb4d3"
server_key_iv: "f4c6ac56734735891f5a97266c109192"
server_key_version: "encryptionkey@0"
I20260812 01:18:39.604553 27085 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 01:18:39.605381 27106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:39.605579 27085 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 01:18:39.605680 27085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "09d0d7ef4b9042f39c5b56850503a31c"
format_stamp: "Formatted at 2026-08-12 01:18:39 on dist-test-slave-rwrg"
server_key: "cda99759435cc74e8936755ceb8eb4d3"
server_key_iv: "f4c6ac56734735891f5a97266c109192"
server_key_version: "encryptionkey@0"
I20260812 01:18:39.605763 27085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:39.609089 27085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:39.611138 27085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:39.611325 27085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:39.615430 27085 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:34347
I20260812 01:18:39.615460 27197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:34347 every 8 connection(s)
I20260812 01:18:39.615782 27085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:39.616796 27200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:39.618988 27200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c: Bootstrap starting.
I20260812 01:18:39.619601 27200 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:39.619886 27200 log.cc:824] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:39.620605 27200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c: No bootstrap required, opened a new log
I20260812 01:18:39.622154 27200 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d0d7ef4b9042f39c5b56850503a31c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34347 } }
I20260812 01:18:39.622321 27200 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:18:39.622359 27200 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d0d7ef4b9042f39c5b56850503a31c, State: Initialized, Role: FOLLOWER
I20260812 01:18:39.622568 27200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d0d7ef4b9042f39c5b56850503a31c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34347 } }
I20260812 01:18:39.622633 27200 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:18:39.622690 27200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:18:39.622741 27200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:39.623556 27200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d0d7ef4b9042f39c5b56850503a31c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34347 } }
I20260812 01:18:39.623670 27200 leader_election.cc:302] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09d0d7ef4b9042f39c5b56850503a31c; no voters:
I20260812 01:18:39.623853 27200 leader_election.cc:288] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:18:39.623885 27204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:39.624055 27204 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [term 1 LEADER]: Becoming Leader. State: Replica: 09d0d7ef4b9042f39c5b56850503a31c, State: Running, Role: LEADER
I20260812 01:18:39.624107 27200 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:39.624210 27204 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d0d7ef4b9042f39c5b56850503a31c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34347 } }
I20260812 01:18:39.624625 27207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09d0d7ef4b9042f39c5b56850503a31c. Latest consensus state: current_term: 1 leader_uuid: "09d0d7ef4b9042f39c5b56850503a31c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d0d7ef4b9042f39c5b56850503a31c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34347 } } }
I20260812 01:18:39.624733 27207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:39.624594 27206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09d0d7ef4b9042f39c5b56850503a31c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d0d7ef4b9042f39c5b56850503a31c" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 34347 } } }
I20260812 01:18:39.625067 27206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:39.625217 27220 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:39.625825 27220 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:39.625840 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 27085
I20260812 01:18:39.625969 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:39.626195 18142 external_mini_cluster.cc:1428] Setting key e783bd736976ed64a31c5f76c1a49ef9
I20260812 01:18:39.627499 27220 catalog_manager.cc:1347] Generated new cluster ID: 199e98efb4c942f7a7bf0b829b49f6c2
I20260812 01:18:39.627552 27220 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:39.634087 27220 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:39.634217 27220 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:39.636704 27220 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09d0d7ef4b9042f39c5b56850503a31c: Generated new TSK 0
I20260812 01:18:39.636894 27220 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:39.636955 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:39.626639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53745 (local address 127.17.183.190:34347)
0812 01:18:39.627266 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:39.627275 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:39.627304 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:18:39.633605 (+ 6301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:39.633615 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:39.633648 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:39.633803 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:39.636403 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:39.636407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:39.636407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:39.636411 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:39.636453 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:39.636464 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:39.636593 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:39.636719 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 01:18:39.636764 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":74,"threads_started":1}
I20260812 01:18:39.637910 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:39.641588 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:39.639383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46957 (local address 127.17.183.190:34347)
0812 01:18:39.639441 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:39.639443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:39.640650 (+ 1207us) server_negotiation.cc:407] Connection header received
0812 01:18:39.640727 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:39.640728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:39.640733 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:39.640812 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:39.641388 (+ 576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:39.641390 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:39.641390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:18:39.641395 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:39.641408 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:18:39.641412 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:39.641461 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:39.641515 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 01:18:39.641528 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 01:18:39.643723 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 27085
2026-08-12T01:18:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1579 ms)
[----------] 18 tests from AuthTokenIssuingTest (29133 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:39 dist-test-slave-rwrg krb5kdc[27253](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:39 dist-test-slave-rwrg krb5kdc[27253](info): set up 2 sockets
Aug 12 01:18:39 dist-test-slave-rwrg krb5kdc[27253](info): commencing operation
krb5kdc: starting...
W20260812 01:18:40.952620 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:18:41.079245 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:40129
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:33227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:40129,127.17.183.189:39549,127.17.183.188:37101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:41.170908 27270 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:18:41.171168 27270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:41.171190 27270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:41.171212 27270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:41.172407 27270 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:41.172446 27270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:41.172461 27270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:41.172475 27270 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:41.172551 27270 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:41.174180 27270 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:33227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:40129,127.17.183.189:39549,127.17.183.188:37101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:40129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:41.174417 27270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:41.174615 27270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:41.179912 27279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:41.179912 27285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:41.179945 27280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:41.179991 27270 server_base.cc:1034] running on GCE node
I20260812 01:18:41.180680 27270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:41.180984 27270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:41.182152 27270 hybrid_clock.cc:648] HybridClock initialized: now 1786497521182139 us; error 44 us; skew 500 ppm
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:41.184777 27270 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:18:41.185230 27270 webserver.cc:460] Webserver started at http://127.17.183.190:33395/ using document root <none> and password file <none>
I20260812 01:18:41.185446 27270 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:41.185511 27270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:41.185663 27270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:41.186704 27270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "61092d2f6e814ad2b4cfe2f0b8022598"
format_stamp: "Formatted at 2026-08-12 01:18:41 on dist-test-slave-rwrg"
server_key: "82558c6df7bdbd9f339d79f5d311af8d"
server_key_iv: "5027bb6923d51048d4295ed53f8eca6f"
server_key_version: "encryptionkey@0"
I20260812 01:18:41.187067 27270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "61092d2f6e814ad2b4cfe2f0b8022598"
format_stamp: "Formatted at 2026-08-12 01:18:41 on dist-test-slave-rwrg"
server_key: "82558c6df7bdbd9f339d79f5d311af8d"
server_key_iv: "5027bb6923d51048d4295ed53f8eca6f"
server_key_version: "encryptionkey@0"
I20260812 01:18:41.188367 27270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 01:18:41.189141 27302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:41.189332 27270 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:18:41.189436 27270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "61092d2f6e814ad2b4cfe2f0b8022598"
format_stamp: "Formatted at 2026-08-12 01:18:41 on dist-test-slave-rwrg"
server_key: "82558c6df7bdbd9f339d79f5d311af8d"
server_key_iv: "5027bb6923d51048d4295ed53f8eca6f"
server_key_version: "encryptionkey@0"
I20260812 01:18:41.189519 27270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:41.210433 27270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:41.213006 27270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:41.213181 27270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:41.217433 27270 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:40129
I20260812 01:18:41.217469 27387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:40129 every 8 connection(s)
I20260812 01:18:41.217825 27270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:41.218734 27389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:41.220217 27389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:41.225463 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 27270
I20260812 01:18:41.225615 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:41.225821 18142 external_mini_cluster.cc:1428] Setting key a87fa647dd9797b519b753dff93b85a7
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:41.229959 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.221041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46130 (local address 127.17.183.190:40129)
0812 01:18:41.221153 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.221157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.221190 (+ 33us) server_negotiation.cc:407] Connection header received
0812 01:18:41.221717 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.221719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.221740 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.221846 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.222372 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.223142 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.223985 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.224284 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.224401 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.226562 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.226571 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.226571 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.226578 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.228321 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.228820 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.228822 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.228823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.228920 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.229195 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.229196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.229196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.229401 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.229464 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.229704 (+ 240us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.229805 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":41,"threads_started":1}
I20260812 01:18:41.230098 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.220895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40129 (local address 127.0.0.1:46130)
0812 01:18:41.221046 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.221080 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:41.221555 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:41.221854 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:41.221857 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:41.222115 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:41.222262 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.222266 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.223243 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.223244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.223883 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.223884 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.224371 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.224373 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.224435 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.224907 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:41.224915 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:41.226475 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:41.228407 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.228414 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.228417 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.228728 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.228987 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.228988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.228988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.229126 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.229475 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:41.229482 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:41.229561 (+ 79us) client_negotiation.cc:769] Sending connection context
0812 01:18:41.229664 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 01:18:41.229914 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":81,"thread_start_us":63,"threads_started":1}
I20260812 01:18:41.230803 27389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:41.231187 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.231039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39549 (local address 127.0.0.1:60068)
0812 01:18:41.231100 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.231154 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 01:18:41.231349 27308 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39549: connect: Connection refused (error 111)
I20260812 01:18:41.231796 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.231693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39549 (local address 127.0.0.1:60082)
0812 01:18:41.231744 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.231769 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 01:18:41.231894 27389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.189:39549: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39549: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.17.183.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab.
Entry for principal kudu/127.17.183.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab.
I20260812 01:18:41.253351 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.189:39549
--webserver_interface=127.17.183.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab
--principal=kudu/127.17.183.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:33227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:40129,127.17.183.189:39549,127.17.183.188:37101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:18:41.281167 27389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } attempt: 1
I20260812 01:18:41.281677 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.281534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39549 (local address 127.0.0.1:60094)
0812 01:18:41.281603 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.281645 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 01:18:41.282135 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.282054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39549 (local address 127.0.0.1:60110)
0812 01:18:41.282093 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.282118 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 01:18:41.282260 27389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.189:39549: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39549: connect: Connection refused (error 111)
W20260812 01:18:41.336807 27398 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:18:41.337015 27398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:41.337033 27398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:41.337054 27398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:41.338203 27398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:41.338241 27398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:41.338255 27398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:41.338268 27398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:41.338280 27398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:41.339687 27398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:33227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:40129,127.17.183.189:39549,127.17.183.188:37101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab
--principal=kudu/127.17.183.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.189:39549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.183.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:41.339884 27398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:41.340044 27398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:41.345083 27417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:41.345160 27414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:41.345163 27410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:41.345350 27398 server_base.cc:1034] running on GCE node
I20260812 01:18:41.345602 27398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:41.345855 27398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:41.346989 27398 hybrid_clock.cc:648] HybridClock initialized: now 1786497521346979 us; error 25 us; skew 500 ppm
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:41.349536 27398 init.cc:377] Logged in from keytab as kudu/127.17.183.189@KRBTEST.COM (short username kudu)
I20260812 01:18:41.349972 27398 webserver.cc:460] Webserver started at http://127.17.183.189:42129/ using document root <none> and password file <none>
I20260812 01:18:41.350205 27398 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:41.350253 27398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:41.350423 27398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:41.350406 27389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } attempt: 2
I20260812 01:18:41.350939 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.350786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39549 (local address 127.0.0.1:60116)
0812 01:18:41.350861 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.350901 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 01:18:41.351320 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.351206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39549 (local address 127.0.0.1:60132)
0812 01:18:41.351256 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.351286 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 01:18:41.351425 27389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.189:39549: Network error: Client connection negotiation failed: client connection to 127.17.183.189:39549: connect: Connection refused (error 111)
I20260812 01:18:41.351790 27398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/data/instance:
uuid: "0b63c2a17f3c4beebb177bb57b521cc3"
format_stamp: "Formatted at 2026-08-12 01:18:41 on dist-test-slave-rwrg"
server_key: "16ef121fbada2c15f6418da0f6d62a67"
server_key_iv: "00be74baa0504db8cf0f1c16cad7aece"
server_key_version: "encryptionkey@0"
I20260812 01:18:41.352170 27398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/wal/instance:
uuid: "0b63c2a17f3c4beebb177bb57b521cc3"
format_stamp: "Formatted at 2026-08-12 01:18:41 on dist-test-slave-rwrg"
server_key: "16ef121fbada2c15f6418da0f6d62a67"
server_key_iv: "00be74baa0504db8cf0f1c16cad7aece"
server_key_version: "encryptionkey@0"
I20260812 01:18:41.353587 27398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:41.354367 27426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:41.354568 27398 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:41.354676 27398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/wal
uuid: "0b63c2a17f3c4beebb177bb57b521cc3"
format_stamp: "Formatted at 2026-08-12 01:18:41 on dist-test-slave-rwrg"
server_key: "16ef121fbada2c15f6418da0f6d62a67"
server_key_iv: "00be74baa0504db8cf0f1c16cad7aece"
server_key_version: "encryptionkey@0"
I20260812 01:18:41.354748 27398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:41.367746 27398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:41.369709 27398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:41.369868 27398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:41.373950 27398 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.189:39549
I20260812 01:18:41.373979 27535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.189:39549 every 8 connection(s)
I20260812 01:18:41.374339 27398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
I20260812 01:18:41.375208 27536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:41.376888 27536 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:41.378615 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 27398
I20260812 01:18:41.378706 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-1/wal/instance
I20260812 01:18:41.378909 18142 external_mini_cluster.cc:1428] Setting key 3cc5383590f0063fdc6ba78adcfc004d
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:41.386472 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.377587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46144 (local address 127.17.183.190:40129)
0812 01:18:41.377650 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.377652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.377869 (+ 217us) server_negotiation.cc:407] Connection header received
0812 01:18:41.378324 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.378325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.378336 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.378392 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.379121 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.379871 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.380940 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.381275 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.381365 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.383530 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.383531 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.383532 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.383540 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.385038 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.385488 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.385490 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.385490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.385553 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.385819 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.385820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.385820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.385936 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.386008 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.386296 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.386381 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 01:18:41.386641 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.377551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40129 (local address 127.0.0.1:46144)
0812 01:18:41.377734 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.377777 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:41.378233 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:41.378459 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:41.378462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:41.378771 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:41.379025 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.379030 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.379968 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.379969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.380853 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.380856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.381376 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.381377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.381473 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.381963 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:41.381970 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:41.383433 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:41.385148 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.385156 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.385158 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.385409 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.385624 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.385625 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.385625 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.385738 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.386011 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:41.386019 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:41.386159 (+ 140us) client_negotiation.cc:769] Sending connection context
0812 01:18:41.386262 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 01:18:41.386413 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":107,"threads_started":1}
I20260812 01:18:41.387246 27536 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.183.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.188@KRBTEST.COM" created.
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
I20260812 01:18:41.394933 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.387588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60148 (local address 127.17.183.189:39549)
0812 01:18:41.387741 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.387745 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.387769 (+ 24us) server_negotiation.cc:407] Connection header received
0812 01:18:41.387827 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.387829 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.387841 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.387905 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.388172 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.388957 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.389657 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.390011 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.390081 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.391967 (+ 1886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.391976 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.391977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.391985 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.393726 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.394149 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.394152 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.394152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.394204 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.394410 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.394411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.394411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.394536 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.394616 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.394778 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.394847 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260812 01:18:41.395093 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.387501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39549 (local address 127.0.0.1:60148)
0812 01:18:41.387549 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.387725 (+ 176us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:41.387769 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:41.387904 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:41.387904 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:41.388041 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:41.388085 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.388086 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.389056 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.389057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.389555 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.389556 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.390082 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.390083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.390147 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.390564 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:41.390568 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:41.391882 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:41.393811 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.393812 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.393812 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.394058 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.394273 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.394274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.394275 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.394348 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.394612 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:41.394613 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:41.394664 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 01:18:41.394758 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 01:18:41.394945 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":69}
I20260812 01:18:41.395778 27536 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:41.396121 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.395975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58386)
0812 01:18:41.396029 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.396085 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 01:18:41.396289 27428 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
I20260812 01:18:41.396771 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.396677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58398)
0812 01:18:41.396729 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.396753 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 01:18:41.396898 27536 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:37101: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab.
Entry for principal kudu/127.17.183.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab.
I20260812 01:18:41.407754 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.188:37101
--webserver_interface=127.17.183.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab
--principal=kudu/127.17.183.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:33227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:40129,127.17.183.189:39549,127.17.183.188:37101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:18:41.442580 27389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } attempt: 3
I20260812 01:18:41.446141 27536 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } attempt: 1
I20260812 01:18:41.446518 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.446403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58404)
0812 01:18:41.446456 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.446489 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 01:18:41.446843 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.446743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58416)
0812 01:18:41.446791 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.446818 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
W20260812 01:18:41.447017 27536 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:37101: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
I20260812 01:18:41.450032 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.443072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60156 (local address 127.17.183.189:39549)
0812 01:18:41.443142 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.443144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.443157 (+ 13us) server_negotiation.cc:407] Connection header received
0812 01:18:41.443234 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.443235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.443255 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.443317 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.443641 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.444139 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.444905 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.445131 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.445220 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.447416 (+ 2196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.447418 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.447418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.447426 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.448869 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.449228 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.449229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.449230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.449303 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.449509 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.449510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.449511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.449635 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.449710 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.449876 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.449949 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 01:18:41.450033 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.442995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39549 (local address 127.0.0.1:60156)
0812 01:18:41.443063 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.443103 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:41.443163 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:41.443324 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:41.443325 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:41.443489 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:41.443555 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.443556 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.444234 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.444235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.444821 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.444823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.445217 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.445218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.445297 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.445762 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:41.445767 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:41.447330 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:41.448961 (+ 1631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.448963 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.448963 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.449155 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.449378 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.449379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.449380 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.449445 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.449712 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:41.449713 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:41.449759 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 01:18:41.449838 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 01:18:41.449937 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 01:18:41.450392 27389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:41.450737 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.450640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58418)
0812 01:18:41.450688 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.450713 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 01:18:41.451089 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.451028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58426)
0812 01:18:41.451052 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.451071 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260812 01:18:41.451184 27389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:37101: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
I20260812 01:18:41.482398 27389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } attempt: 1
I20260812 01:18:41.482865 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.482740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58440)
0812 01:18:41.482802 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.482838 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 01:18:41.483332 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.483233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58446)
0812 01:18:41.483290 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.483315 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 01:18:41.483448 27389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:37101: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
W20260812 01:18:41.495620 27548 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:18:41.495896 27548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:41.495939 27548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:41.495982 27548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:41.497344 27548 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:41.497412 27548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:41.497438 27548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:41.497469 27548 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:41.497498 27548 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:41.499024 27548 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:33227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:40129,127.17.183.189:39549,127.17.183.188:37101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab
--principal=kudu/127.17.183.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.188:37101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.183.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:41.499322 27548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:41.499550 27548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:41.504590 27557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:41.504596 27561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:41.504642 27548 server_base.cc:1034] running on GCE node
W20260812 01:18:41.504606 27556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:41.505023 27548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:41.505327 27548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:41.506472 27548 hybrid_clock.cc:648] HybridClock initialized: now 1786497521506455 us; error 40 us; skew 500 ppm
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:41.508985 27548 init.cc:377] Logged in from keytab as kudu/127.17.183.188@KRBTEST.COM (short username kudu)
I20260812 01:18:41.509471 27548 webserver.cc:460] Webserver started at http://127.17.183.188:41109/ using document root <none> and password file <none>
I20260812 01:18:41.509696 27548 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:41.509742 27548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:41.509892 27548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:41.510934 27548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/data/instance:
uuid: "3b1d4d82f39c4739855facd60753c9d8"
format_stamp: "Formatted at 2026-08-12 01:18:41 on dist-test-slave-rwrg"
server_key: "b75c950c940122d2b37788dc280fb4f5"
server_key_iv: "d1c8a32ec1790dd574dd90fdec7cf39c"
server_key_version: "encryptionkey@0"
I20260812 01:18:41.511312 27548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/wal/instance:
uuid: "3b1d4d82f39c4739855facd60753c9d8"
format_stamp: "Formatted at 2026-08-12 01:18:41 on dist-test-slave-rwrg"
server_key: "b75c950c940122d2b37788dc280fb4f5"
server_key_iv: "d1c8a32ec1790dd574dd90fdec7cf39c"
server_key_version: "encryptionkey@0"
I20260812 01:18:41.512714 27548 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 01:18:41.513463 27571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:41.513644 27548 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 01:18:41.513752 27548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/wal
uuid: "3b1d4d82f39c4739855facd60753c9d8"
format_stamp: "Formatted at 2026-08-12 01:18:41 on dist-test-slave-rwrg"
server_key: "b75c950c940122d2b37788dc280fb4f5"
server_key_iv: "d1c8a32ec1790dd574dd90fdec7cf39c"
server_key_version: "encryptionkey@0"
I20260812 01:18:41.513827 27548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:41.515165 27536 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } attempt: 2
I20260812 01:18:41.515553 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.515423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58460)
0812 01:18:41.515484 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.515520 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 01:18:41.515893 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.515810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58468)
0812 01:18:41.515852 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.515876 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 01:18:41.516004 27536 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:37101: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37101: connect: Connection refused (error 111)
I20260812 01:18:41.520782 27548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:41.522797 27548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:41.522971 27548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:41.527325 27548 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.188:37101
I20260812 01:18:41.527356 27664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.188:37101 every 8 connection(s)
I20260812 01:18:41.527740 27548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
I20260812 01:18:41.528720 27665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:41.530272 27665 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:41.532966 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 27548
I20260812 01:18:41.533056 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786497235894345-18142-0/minicluster-data/master-2/wal/instance
I20260812 01:18:41.533237 18142 external_mini_cluster.cc:1428] Setting key 9d76bf26be2b08f8995da2f602259edf
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
I20260812 01:18:41.540726 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.530994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46146 (local address 127.17.183.190:40129)
0812 01:18:41.531058 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.531060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.531284 (+ 224us) server_negotiation.cc:407] Connection header received
0812 01:18:41.531733 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.531735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.531746 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.531805 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.532424 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.533046 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.534419 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.534601 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.534655 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.537218 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.537219 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.537220 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.537228 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.538967 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.539488 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.539489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.539489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.539552 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.539868 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.539870 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.539870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.539993 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.540069 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.540410 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.540604 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 01:18:41.540831 27667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.530965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:40129 (local address 127.0.0.1:46146)
0812 01:18:41.531157 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.531193 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:41.531631 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:41.531883 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:41.531887 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:41.532122 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:41.532313 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.532317 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.533179 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.533181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.534326 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.534330 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.534699 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.534701 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.534859 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.535485 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:41.535494 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:41.537126 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:41.539077 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.539086 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.539088 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.539401 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.539635 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.539636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.539637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.539791 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.540074 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:41.540081 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:41.540234 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 01:18:41.540356 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 01:18:41.540583 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":116,"threads_started":1}
I20260812 01:18:41.541751 27665 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:41.543414 27669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.533678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58484 (local address 127.17.183.188:37101)
0812 01:18:41.534034 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.534038 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.534053 (+ 15us) server_negotiation.cc:407] Connection header received
0812 01:18:41.534069 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.534071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.534085 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.534140 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.534995 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.535865 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.536857 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.537310 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.537364 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.540141 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.540147 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.540147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.540154 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.542174 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.542593 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.542596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.542596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.542649 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.542866 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.542867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.542867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.542994 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.543110 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.543223 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.543294 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":107,"threads_started":1}
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:41.549599 27667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.542029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:39549 (local address 127.0.0.1:60172)
0812 01:18:41.542083 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.542094 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:41.542137 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:41.542293 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:41.542294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:41.542410 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:41.542438 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.542440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.543359 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.543360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.544040 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.544043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.544475 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.544476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.544576 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.544997 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:41.545002 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:41.546200 (+ 1198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:41.547863 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.547864 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.547864 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.548124 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.548339 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.548340 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.548341 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.548418 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.549221 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:41.549223 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:41.549288 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 01:18:41.549388 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 01:18:41.549489 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 01:18:41.549595 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.542103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60172 (local address 127.17.183.189:39549)
0812 01:18:41.542161 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.542164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.542175 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:18:41.542202 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.542203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.542213 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.542274 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.542518 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.543275 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.544100 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.544406 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.544466 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.546296 (+ 1830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.546298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.546298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.546304 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.547773 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.548206 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.548207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.548207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.548265 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.549033 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.549034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.549035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.549140 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.549197 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.549403 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.549491 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 01:18:41.550180 27665 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:41.552482 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.544216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46152 (local address 127.17.183.190:40129)
0812 01:18:41.544261 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.544263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.544644 (+ 381us) server_negotiation.cc:407] Connection header received
0812 01:18:41.544709 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.544710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.544720 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.544785 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.545319 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.545826 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.546692 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.546906 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.547006 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.549497 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.549499 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.549499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.549505 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.551360 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.551721 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.551721 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.551722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.551789 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.552041 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.552042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.552042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.552145 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.552284 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.552367 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.552424 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
I20260812 01:18:41.557498 27667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.550452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58498)
0812 01:18:41.550560 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.550571 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:41.550621 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:41.550750 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:41.550750 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:41.550865 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:41.550892 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.550893 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.551707 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.551708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.552561 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.552564 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.552995 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.552996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.553058 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.553464 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:41.553469 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:41.554604 (+ 1135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:41.556305 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.556307 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.556307 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.556617 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.556833 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.556834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.556834 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.556927 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.557165 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:41.557166 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:41.557205 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 01:18:41.557292 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 01:18:41.557391 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260812 01:18:41.557554 27669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.550516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58498 (local address 127.17.183.188:37101)
0812 01:18:41.550562 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.550564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.550606 (+ 42us) server_negotiation.cc:407] Connection header received
0812 01:18:41.550685 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.550686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.550695 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.550745 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.550962 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.551627 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.552649 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.552913 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.552995 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.554685 (+ 1690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.554686 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.554687 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.554694 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.556179 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.556701 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.556702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.556702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.556755 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.557004 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.557004 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.557004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.557094 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.557172 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.557320 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.557439 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":28}
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
I20260812 01:18:41.558595 27389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } attempt: 2
I20260812 01:18:41.559165 27665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8: Bootstrap starting.
I20260812 01:18:41.560700 27665 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:41.561065 27665 log.cc:824] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:41.562179 27665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8: No bootstrap required, opened a new log
I20260812 01:18:41.562247 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.553552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60182 (local address 127.17.183.189:39549)
0812 01:18:41.553630 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.553631 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.553639 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:18:41.553657 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.553658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.553666 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.553754 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.554256 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.554908 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.555620 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.555828 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.555911 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.559039 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.559040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.559040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.559047 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.560934 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.561358 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.561359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.561359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.561417 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.561633 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.561635 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.561635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.561786 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.561927 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.562071 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.562147 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
I20260812 01:18:41.564457 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:41.564695 27665 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } }
I20260812 01:18:41.564828 27665 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b1d4d82f39c4739855facd60753c9d8, State: Initialized, Role: FOLLOWER
I20260812 01:18:41.564888 27665 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } }
I20260812 01:18:41.565212 27665 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:41.565153 27674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } } }
I20260812 01:18:41.565258 27674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:41.566737 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.558856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58504)
0812 01:18:41.558909 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.558919 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:41.558956 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:41.559126 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:41.559127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:41.559331 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:41.559385 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.559387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.560103 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.560104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.560688 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.560690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.561174 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.561176 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.561242 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.561970 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:41.561974 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:41.563445 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:41.565406 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.565407 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.565408 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.565669 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.565977 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.565979 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.565979 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.566050 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.566424 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:41.566425 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:41.566473 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 01:18:41.566545 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 01:18:41.566637 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 01:18:41.565867 27345 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "61092d2f6e814ad2b4cfe2f0b8022598"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46152
I20260812 01:18:41.566797 27669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.558915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58504 (local address 127.17.183.188:37101)
0812 01:18:41.558952 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.558954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.558963 (+ 9us) server_negotiation.cc:407] Connection header received
0812 01:18:41.559018 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.559019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.559027 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.559104 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.559476 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.559972 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.560803 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.561067 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.561401 (+ 334us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.563537 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.563538 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.563538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.563544 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.565262 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.565780 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.565781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.565782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.565851 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.566139 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.566140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.566140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.566336 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.566428 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.566591 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.566683 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":18}
W20260812 01:18:41.567449 27695 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:18:41.567507 27695 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:18:41.568686 27389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598: Bootstrap starting.
I20260812 01:18:41.569360 27389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:41.569697 27389 log.cc:824] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:41.567564 27548 master_runner.cc:186] Error getting master registration for 127.17.183.190:40129: OK, instance_id { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" instance_seqno: 1786497521216172 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:18:41.570026 27548 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:18:41.570537 27389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598: No bootstrap required, opened a new log
I20260812 01:18:41.571573 27389 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } }
I20260812 01:18:41.571686 27389 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61092d2f6e814ad2b4cfe2f0b8022598, State: Initialized, Role: FOLLOWER
I20260812 01:18:41.571803 27389 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } }
I20260812 01:18:41.572178 27389 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:41.572197 27345 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 01:18:41.572206 27702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } } }
I20260812 01:18:41.572356 27345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:41.573364 27345 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } }
I20260812 01:18:41.573665 27345 leader_election.cc:288] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [CANDIDATE]: Term 1 election: Requested vote from peers 0b63c2a17f3c4beebb177bb57b521cc3 (127.17.183.189:39549), 3b1d4d82f39c4739855facd60753c9d8 (127.17.183.188:37101)
I20260812 01:18:41.573894 27617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3b1d4d82f39c4739855facd60753c9d8"
I20260812 01:18:41.574007 27617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:41.574867 27702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:41.574941 27617 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61092d2f6e814ad2b4cfe2f0b8022598 in term 1.
I20260812 01:18:41.575191 27304 leader_election.cc:302] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b1d4d82f39c4739855facd60753c9d8, 61092d2f6e814ad2b4cfe2f0b8022598; no voters:
I20260812 01:18:41.575407 27702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:41.575595 27702 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [term 1 LEADER]: Becoming Leader. State: Replica: 61092d2f6e814ad2b4cfe2f0b8022598, State: Running, Role: LEADER
I20260812 01:18:41.575731 27702 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } }
I20260812 01:18:41.576327 27702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61092d2f6e814ad2b4cfe2f0b8022598. Latest consensus state: current_term: 1 leader_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } } }
I20260812 01:18:41.576481 27702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:41.575331 27270 master_runner.cc:186] Error getting master registration for 127.17.183.189:39549: OK, instance_id { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" instance_seqno: 1786497521372831 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:18:41.578358 27270 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 01:18:41.578933 27719 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:18:41.578982 27719 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:18:41.579028 27729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:41.579205 27729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:41.581194 27617 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [term 1 FOLLOWER]: Refusing update from remote peer 61092d2f6e814ad2b4cfe2f0b8022598: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:41.588563 27726 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:41.589993 27674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61092d2f6e814ad2b4cfe2f0b8022598. Latest consensus state: current_term: 1 leader_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } } }
I20260812 01:18:41.590121 27674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:41.590351 27669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.580185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58518 (local address 127.17.183.188:37101)
0812 01:18:41.580239 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.580241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.581569 (+ 1328us) server_negotiation.cc:407] Connection header received
0812 01:18:41.581792 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.581793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.581806 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.581854 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.582844 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.583321 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.584355 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.584696 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.584773 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.586591 (+ 1818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.586592 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.586593 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.586622 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.588561 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.588993 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.588994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.588995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.589078 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.589403 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.589404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.589405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.589547 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.589625 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.589876 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.589965 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 01:18:41.592783 27726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } } }
I20260812 01:18:41.592905 27726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:41.593341 27674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } } }
I20260812 01:18:41.593427 27674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:41.593623 27731 mvcc.cc:205] Tried to move back new op lower bound from 7317493848393510912 to 7317493848375447552. Current Snapshot: MvccSnapshot[applied={T|T < 7317493848393510912 or (T in {7317493848393510912})}]
I20260812 01:18:41.593670 27729 catalog_manager.cc:1347] Generated new cluster ID: 678cfeb4df8c4ee49b42bd27f0dccbe5
I20260812 01:18:41.593719 27729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:41.593729 27744 mvcc.cc:205] Tried to move back new op lower bound from 7317493848393510912 to 7317493848375447552. Current Snapshot: MvccSnapshot[applied={T|T < 7317493848393510912}]
I20260812 01:18:41.605479 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.580944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60196 (local address 127.17.183.189:39549)
0812 01:18:41.580990 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.580992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.590721 (+ 9729us) server_negotiation.cc:407] Connection header received
0812 01:18:41.590890 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.590892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.590904 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.590939 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.593582 (+ 2643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.594354 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.596791 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.597163 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.597204 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.599913 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.599915 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.599915 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.599923 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.601687 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.604259 (+ 2572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.604260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.604261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.604323 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.604558 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.604559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.604559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.604696 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.604779 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.605298 (+ 519us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.605378 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 01:18:41.607065 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.580677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46156 (local address 127.17.183.190:40129)
0812 01:18:41.580715 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.580717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.590107 (+ 9390us) server_negotiation.cc:407] Connection header received
0812 01:18:41.590205 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.590206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.590216 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.590248 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.591904 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.592781 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.595943 (+ 3162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.596240 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.596277 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.602105 (+ 5828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.602107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.602107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.602115 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.603839 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.604973 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.604974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.604974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.605037 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.606347 (+ 1310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.606348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.606349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.606554 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.606645 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.606880 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.606967 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:18:41.607146 27536 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } attempt: 3
Aug 12 01:18:41 dist-test-slave-rwrg krb5kdc[27253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497521, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
I20260812 01:18:41.615724 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.607389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37101 (local address 127.0.0.1:58532)
0812 01:18:41.607471 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:41.607481 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:41.607517 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:41.607750 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:41.607751 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:41.607908 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:41.607945 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.607946 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.608893 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.608894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.609699 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:41.609701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.610202 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.610203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:41.610258 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.611297 (+ 1039us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:41.611303 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:41.612802 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:41.614599 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.614600 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.614601 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.614805 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.615052 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:41.615052 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:41.615053 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:41.615116 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:41.615419 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:41.615420 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:41.615475 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 01:18:41.615544 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 01:18:41.615631 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 01:18:41.616248 27669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:41.607585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58532 (local address 127.17.183.188:37101)
0812 01:18:41.607620 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.607622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.607629 (+ 7us) server_negotiation.cc:407] Connection header received
0812 01:18:41.607649 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.607650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.607658 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.607701 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.608024 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.608786 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.609805 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:41.610096 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:41.610153 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:41.612932 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:41.612933 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:41.612934 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:41.612940 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:41.614514 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.614904 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.614905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.614906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.614974 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:41.615188 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:41.615189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:41.615189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:41.615317 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:41.615369 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:41.616094 (+ 725us) server_negotiation.cc:299] Negotiation successful
0812 01:18:41.616167 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:18:41.617906 27536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3: Bootstrap starting.
I20260812 01:18:41.618234 27729 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:41.618654 27536 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:41.619009 27536 log.cc:824] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:41.619051 27729 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:41.629160 27536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3: No bootstrap required, opened a new log
I20260812 01:18:41.631245 27536 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } }
I20260812 01:18:41.631392 27536 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63c2a17f3c4beebb177bb57b521cc3, State: Initialized, Role: FOLLOWER
I20260812 01:18:41.631476 27536 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } }
I20260812 01:18:41.631850 27536 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:41.631966 27473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:41.632961 27473 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [term 1 FOLLOWER]: Refusing update from remote peer 61092d2f6e814ad2b4cfe2f0b8022598: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:41.633148 27474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0b63c2a17f3c4beebb177bb57b521cc3"
I20260812 01:18:41.633441 27702 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:41.631855 27750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } } }
I20260812 01:18:41.633692 27750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:41.634640 27474 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61092d2f6e814ad2b4cfe2f0b8022598 in term 1.
I20260812 01:18:41.636466 27750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61092d2f6e814ad2b4cfe2f0b8022598. Latest consensus state: current_term: 1 leader_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } } }
I20260812 01:18:41.636245 27729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598: Generated new TSK 0
I20260812 01:18:41.636843 27729 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:18:41.637257 27750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:41.637375 27750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } } }
I20260812 01:18:41.637562 27750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 01:18:41.637445 27767 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:18:41.637722 27767 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:18:41.638314 27770 mvcc.cc:205] Tried to move back new op lower bound from 7317493848541159424 to 7317493848375447552. Current Snapshot: MvccSnapshot[applied={T|T < 7317493848393510912}]
I20260812 01:18:41.639205 27726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61092d2f6e814ad2b4cfe2f0b8022598" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 40129 } } peers { permanent_uuid: "0b63c2a17f3c4beebb177bb57b521cc3" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 39549 } } peers { permanent_uuid: "3b1d4d82f39c4739855facd60753c9d8" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37101 } } }
I20260812 01:18:41.639308 27726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61092d2f6e814ad2b4cfe2f0b8022598 [sys.catalog]: This master's current role is: LEADER
W20260812 01:18:41.669456 27543 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.667580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60210 (local address 127.17.183.189:39549)
0812 01:18:41.667629 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.667632 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.668695 (+ 1063us) server_negotiation.cc:407] Connection header received
0812 01:18:41.668825 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.668827 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.668839 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.668873 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.669381 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60210: BlockingRecv error: recv got EOF from 127.0.0.1:60210 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 01:18:41.670475 27392 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.667994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46160 (local address 127.17.183.190:40129)
0812 01:18:41.668038 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.668040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.669869 (+ 1829us) server_negotiation.cc:407] Connection header received
0812 01:18:41.669978 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.669980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.669991 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.670024 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.670404 (+ 380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46160: BlockingRecv error: recv got EOF from 127.0.0.1:46160 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 01:18:41.671409 27669 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.668381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58542 (local address 127.17.183.188:37101)
0812 01:18:41.668425 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.668427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.670867 (+ 2440us) server_negotiation.cc:407] Connection header received
0812 01:18:41.670976 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.670978 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.670988 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.671022 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.671343 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58542: BlockingRecv error: recv got EOF from 127.0.0.1:58542 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 01:18:41.674366 27543 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.673491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60224 (local address 127.17.183.189:39549)
0812 01:18:41.673542 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.673543 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.673800 (+ 257us) server_negotiation.cc:407] Connection header received
0812 01:18:41.673921 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.673922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.673942 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.673974 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.674313 (+ 339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60224: BlockingRecv error: recv got EOF from 127.0.0.1:60224 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260812 01:18:41.677716 27543 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.676835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60230 (local address 127.17.183.189:39549)
0812 01:18:41.676871 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.676873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.677141 (+ 268us) server_negotiation.cc:407] Connection header received
0812 01:18:41.677240 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.677242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.677252 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.677301 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.677667 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60230: BlockingRecv error: recv got EOF from 127.0.0.1:60230 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 01:18:41.681941 27543 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.681096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60242 (local address 127.17.183.189:39549)
0812 01:18:41.681133 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.681135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.681390 (+ 255us) server_negotiation.cc:407] Connection header received
0812 01:18:41.681498 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.681499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.681525 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.681557 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.681892 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60242: BlockingRecv error: recv got EOF from 127.0.0.1:60242 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 01:18:41.687942 27543 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.687097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60256 (local address 127.17.183.189:39549)
0812 01:18:41.687131 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.687133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.687402 (+ 269us) server_negotiation.cc:407] Connection header received
0812 01:18:41.687518 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.687519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.687530 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.687562 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.687894 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60256: BlockingRecv error: recv got EOF from 127.0.0.1:60256 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 01:18:41.698025 27543 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.697164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60268 (local address 127.17.183.189:39549)
0812 01:18:41.697201 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.697203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.697467 (+ 264us) server_negotiation.cc:407] Connection header received
0812 01:18:41.697588 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.697590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.697601 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.697633 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.697974 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60268: BlockingRecv error: recv got EOF from 127.0.0.1:60268 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 01:18:41.716339 27543 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.715371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60270 (local address 127.17.183.189:39549)
0812 01:18:41.715414 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.715416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.715701 (+ 285us) server_negotiation.cc:407] Connection header received
0812 01:18:41.715828 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.715829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.715853 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.715885 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.716288 (+ 403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60270: BlockingRecv error: recv got EOF from 127.0.0.1:60270 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 01:18:41.750720 27543 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.749756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60284 (local address 127.17.183.189:39549)
0812 01:18:41.749803 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.749806 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.750110 (+ 304us) server_negotiation.cc:407] Connection header received
0812 01:18:41.750215 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.750216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.750227 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.750259 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.750644 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60284: BlockingRecv error: recv got EOF from 127.0.0.1:60284 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 01:18:41.817031 27543 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.816193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60290 (local address 127.17.183.189:39549)
0812 01:18:41.816266 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.816269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.816390 (+ 121us) server_negotiation.cc:407] Connection header received
0812 01:18:41.816456 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.816457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.816468 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.816541 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.816942 (+ 401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60290: BlockingRecv error: recv got EOF from 127.0.0.1:60290 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260812 01:18:41.947081 27543 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:41.946258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60294 (local address 127.17.183.189:39549)
0812 01:18:41.946345 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:41.946347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:41.946477 (+ 130us) server_negotiation.cc:407] Connection header received
0812 01:18:41.946532 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:41.946534 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:41.946544 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:41.946597 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:41.946974 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60294: BlockingRecv error: recv got EOF from 127.0.0.1:60294 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260812 01:18:42.205200 27543 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:42.204567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60308 (local address 127.17.183.189:39549)
0812 01:18:42.204631 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:42.204633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:42.204643 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:18:42.204673 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:42.204674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:42.204684 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:42.204755 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:42.205109 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60308: BlockingRecv error: recv got EOF from 127.0.0.1:60308 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 01:18:42.567957 27695 catalog_manager.cc:1259] Loaded cluster ID: 678cfeb4df8c4ee49b42bd27f0dccbe5
I20260812 01:18:42.568034 27695 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8: loading cluster ID for follower catalog manager: success
I20260812 01:18:42.568876 27695 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8: acquiring CA information for follower catalog manager: success
I20260812 01:18:42.569192 27695 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3b1d4d82f39c4739855facd60753c9d8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:18:42.638276 27767 catalog_manager.cc:1259] Loaded cluster ID: 678cfeb4df8c4ee49b42bd27f0dccbe5
I20260812 01:18:42.638363 27767 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3: loading cluster ID for follower catalog manager: success
I20260812 01:18:42.639222 27767 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3: acquiring CA information for follower catalog manager: success
I20260812 01:18:42.639565 27767 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0b63c2a17f3c4beebb177bb57b521cc3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:18:42.721230 27912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:42.718479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60322 (local address 127.17.183.189:39549)
0812 01:18:42.718651 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:42.718654 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:42.718703 (+ 49us) server_negotiation.cc:407] Connection header received
0812 01:18:42.718778 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:42.718779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:42.718842 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:42.718940 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:42.719102 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:42.719600 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:42.720386 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:42.720605 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:42.720684 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:42.720860 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:42.720982 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:42.721066 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:42.721107 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 01:18:42.721130 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":82,"threads_started":1}
I20260812 01:18:42.725486 27922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:42.723119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58552 (local address 127.17.183.188:37101)
0812 01:18:42.723228 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:42.723229 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:42.723247 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:18:42.723287 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:42.723288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:42.723324 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:42.723388 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:42.723484 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:42.723932 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:42.724692 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:42.724901 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:42.724954 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:42.725176 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:42.725284 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:42.725343 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:42.725402 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 01:18:42.725421 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":62,"threads_started":1}
I20260812 01:18:42.730197 27922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:42.727321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58558 (local address 127.17.183.188:37101)
0812 01:18:42.727360 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:42.727362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:42.727524 (+ 162us) server_negotiation.cc:407] Connection header received
0812 01:18:42.727610 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:42.727612 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:42.727622 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:42.727682 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:42.727835 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:42.728310 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:42.729420 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:42.729678 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:42.729709 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:42.729910 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:42.729945 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:42.729978 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:42.730084 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 01:18:42.730106 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:18:42.730398 27912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:42.727223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60326 (local address 127.17.183.189:39549)
0812 01:18:42.727276 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:42.727278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:42.727481 (+ 203us) server_negotiation.cc:407] Connection header received
0812 01:18:42.727539 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:42.727540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:42.727552 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:42.727589 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:42.727762 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:42.728548 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:42.729552 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:42.729842 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:42.729897 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:42.730071 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:42.730110 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:42.730201 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:42.730299 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 01:18:42.730326 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 01:18:42.730417 27933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:42.727223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46172 (local address 127.17.183.190:40129)
0812 01:18:42.727386 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:42.727388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:42.727512 (+ 124us) server_negotiation.cc:407] Connection header received
0812 01:18:42.727563 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:42.727565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:42.727618 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:42.727694 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:42.727878 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:42.728653 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:42.729422 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:42.729746 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:42.729812 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:42.730012 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:42.730124 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:42.730188 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:42.730261 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 01:18:42.730333 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":63,"threads_started":1}
I20260812 01:18:42.732666 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 27270
I20260812 01:18:42.744613 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 27398
I20260812 01:18:42.759505 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 27548
2026-08-12T01:18:42Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3118 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:18:42 dist-test-slave-rwrg krb5kdc[27942](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:18:42 dist-test-slave-rwrg krb5kdc[27942](info): set up 2 sockets
Aug 12 01:18:42 dist-test-slave-rwrg krb5kdc[27942](info): commencing operation
krb5kdc: starting...
W20260812 01:18:44.116680 18142 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/test-user.keytab.
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:18:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:18:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.183.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
Entry for principal kudu/127.17.183.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab.
I20260812 01:18:44.239292 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:45811
--webserver_interface=127.17.183.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:45811,127.17.183.189:33181,127.17.183.188:37971
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:18:44.322355 27970 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:18:44.322570 27970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:44.322587 27970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:44.322607 27970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:44.323784 27970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:44.323824 27970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:44.323839 27970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:44.323851 27970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:44.323863 27970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:44.325379 27970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:45811,127.17.183.189:33181,127.17.183.188:37971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.190.keytab
--principal=kudu/127.17.183.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.190:45811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.183.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:44.325626 27970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:44.325803 27970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:44.330729 27981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:44.330852 27970 server_base.cc:1034] running on GCE node
W20260812 01:18:44.330754 27979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:44.330770 27977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:44.331226 27970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:44.331491 27970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:44.332636 27970 hybrid_clock.cc:648] HybridClock initialized: now 1786497524332620 us; error 28 us; skew 500 ppm
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:44.335203 27970 init.cc:377] Logged in from keytab as kudu/127.17.183.190@KRBTEST.COM (short username kudu)
I20260812 01:18:44.335695 27970 webserver.cc:460] Webserver started at http://127.17.183.190:45813/ using document root <none> and password file <none>
I20260812 01:18:44.335942 27970 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:44.336011 27970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:44.336163 27970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:44.337565 27970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/data/instance:
uuid: "d39f25e72ca44a06afefac818075fe8e"
format_stamp: "Formatted at 2026-08-12 01:18:44 on dist-test-slave-rwrg"
server_key: "cd51c67e0eef3e8fd7576879a512b358"
server_key_iv: "3fdc5850e9b94ffcbbbd79d7766a3cc9"
server_key_version: "encryptionkey@0"
I20260812 01:18:44.337958 27970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/wal/instance:
uuid: "d39f25e72ca44a06afefac818075fe8e"
format_stamp: "Formatted at 2026-08-12 01:18:44 on dist-test-slave-rwrg"
server_key: "cd51c67e0eef3e8fd7576879a512b358"
server_key_iv: "3fdc5850e9b94ffcbbbd79d7766a3cc9"
server_key_version: "encryptionkey@0"
I20260812 01:18:44.339330 27970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:44.340052 27995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:44.340233 27970 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:44.340348 27970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/wal
uuid: "d39f25e72ca44a06afefac818075fe8e"
format_stamp: "Formatted at 2026-08-12 01:18:44 on dist-test-slave-rwrg"
server_key: "cd51c67e0eef3e8fd7576879a512b358"
server_key_iv: "3fdc5850e9b94ffcbbbd79d7766a3cc9"
server_key_version: "encryptionkey@0"
I20260812 01:18:44.340407 27970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:44.371822 27970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:44.373817 27970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:44.373996 27970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:44.378316 27970 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.190:45811
I20260812 01:18:44.378352 28084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.190:45811 every 8 connection(s)
I20260812 01:18:44.378747 27970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/data/info.pb
I20260812 01:18:44.379633 28085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:44.381270 28085 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:44.384557 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 27970
I20260812 01:18:44.384683 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-0/wal/instance
I20260812 01:18:44.384871 18142 external_mini_cluster.cc:1428] Setting key e77bec5424c514a5fd7d42538f389972
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:44.391392 28090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.382130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36926 (local address 127.17.183.190:45811)
0812 01:18:44.382266 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.382270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.382308 (+ 38us) server_negotiation.cc:407] Connection header received
0812 01:18:44.382764 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.382766 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.382782 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.382857 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.383359 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.384190 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.385240 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.385731 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.385843 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.388089 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.388097 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.388097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.388104 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.389768 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.390179 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.390182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.390182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.390261 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.390502 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.390503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.390503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.390708 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.390795 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.390997 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.391145 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":10,"server-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
I20260812 01:18:44.391395 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.381979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:45811 (local address 127.0.0.1:36926)
0812 01:18:44.382146 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.382181 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:44.382633 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:44.382905 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:44.382907 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:44.383136 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:44.383281 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.383284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.384289 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.384290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.385155 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.385157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.385822 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.385822 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.385877 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.386430 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:44.386438 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:44.387998 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:44.389873 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.389880 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.389882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.390082 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.390333 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.390334 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.390335 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.390425 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.390791 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:44.390796 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:44.390856 (+ 60us) client_negotiation.cc:769] Sending connection context
0812 01:18:44.390964 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 01:18:44.391192 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":95,"thread_start_us":69,"threads_started":1}
I20260812 01:18:44.392200 28085 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:44.392609 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.392434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:33181 (local address 127.0.0.1:58334)
0812 01:18:44.392485 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.392577 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:33181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 01:18:44.392768 28000 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.183.189:33181: connect: Connection refused (error 111)
I20260812 01:18:44.393229 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.393137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:33181 (local address 127.0.0.1:58344)
0812 01:18:44.393188 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.393212 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:33181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 01:18:44.393369 28085 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.189:33181: Network error: Client connection negotiation failed: client connection to 127.17.183.189:33181: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.17.183.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab.
Entry for principal kudu/127.17.183.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab.
I20260812 01:18:44.413587 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.189:33181
--webserver_interface=127.17.183.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab
--principal=kudu/127.17.183.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:45811,127.17.183.189:33181,127.17.183.188:37971
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:18:44.442602 28085 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } attempt: 1
I20260812 01:18:44.443094 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.442953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:33181 (local address 127.0.0.1:58346)
0812 01:18:44.443019 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.443063 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:33181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 01:18:44.443461 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.443356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:33181 (local address 127.0.0.1:58348)
0812 01:18:44.443404 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.443429 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:33181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 01:18:44.443557 28085 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.189:33181: Network error: Client connection negotiation failed: client connection to 127.17.183.189:33181: connect: Connection refused (error 111)
W20260812 01:18:44.499534 28097 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:18:44.499796 28097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:44.499825 28097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:44.499867 28097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:44.501008 28097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:44.501073 28097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:44.501099 28097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:44.501119 28097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:44.501151 28097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:44.502655 28097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:45811,127.17.183.189:33181,127.17.183.188:37971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.189.keytab
--principal=kudu/127.17.183.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.189:33181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.183.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:44.502925 28097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:44.503149 28097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:44.508117 28107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:44.508153 28110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:44.508158 28112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:44.508306 28097 server_base.cc:1034] running on GCE node
I20260812 01:18:44.508690 28097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:44.508973 28097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:44.510171 28097 hybrid_clock.cc:648] HybridClock initialized: now 1786497524510158 us; error 28 us; skew 500 ppm
I20260812 01:18:44.511714 28085 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } attempt: 2
I20260812 01:18:44.512152 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.512006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:33181 (local address 127.0.0.1:58352)
0812 01:18:44.512083 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.512120 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:33181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 01:18:44.512590 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.512475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:33181 (local address 127.0.0.1:58360)
0812 01:18:44.512536 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.512565 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.189:33181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 01:18:44.512683 28085 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.189:33181: Network error: Client connection negotiation failed: client connection to 127.17.183.189:33181: connect: Connection refused (error 111)
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:44.513284 28097 init.cc:377] Logged in from keytab as kudu/127.17.183.189@KRBTEST.COM (short username kudu)
I20260812 01:18:44.513855 28097 webserver.cc:460] Webserver started at http://127.17.183.189:41661/ using document root <none> and password file <none>
I20260812 01:18:44.514120 28097 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:44.514276 28097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:44.514482 28097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:44.515781 28097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/data/instance:
uuid: "f6d9b4f393e547c2941dc4314b9208cf"
format_stamp: "Formatted at 2026-08-12 01:18:44 on dist-test-slave-rwrg"
server_key: "60fcd555e9e5e5676237aedd69fe100b"
server_key_iv: "aff15fc1a00ef14b707a503c04f6bb75"
server_key_version: "encryptionkey@0"
I20260812 01:18:44.516242 28097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/wal/instance:
uuid: "f6d9b4f393e547c2941dc4314b9208cf"
format_stamp: "Formatted at 2026-08-12 01:18:44 on dist-test-slave-rwrg"
server_key: "60fcd555e9e5e5676237aedd69fe100b"
server_key_iv: "aff15fc1a00ef14b707a503c04f6bb75"
server_key_version: "encryptionkey@0"
I20260812 01:18:44.517799 28097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260812 01:18:44.518642 28126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:44.518839 28097 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:18:44.518954 28097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/wal
uuid: "f6d9b4f393e547c2941dc4314b9208cf"
format_stamp: "Formatted at 2026-08-12 01:18:44 on dist-test-slave-rwrg"
server_key: "60fcd555e9e5e5676237aedd69fe100b"
server_key_iv: "aff15fc1a00ef14b707a503c04f6bb75"
server_key_version: "encryptionkey@0"
I20260812 01:18:44.519060 28097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:44.536058 28097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:44.538031 28097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:44.538200 28097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:44.542536 28097 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.189:33181
I20260812 01:18:44.542593 28223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.189:33181 every 8 connection(s)
I20260812 01:18:44.542968 28097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/data/info.pb
I20260812 01:18:44.544032 28224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:44.545799 28224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:44.549173 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 28097
I20260812 01:18:44.549306 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-1/wal/instance
I20260812 01:18:44.549504 18142 external_mini_cluster.cc:1428] Setting key 4ad6ff7fc3cfcf4d481d84f743d43a21
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:44.555905 28090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.546571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36942 (local address 127.17.183.190:45811)
0812 01:18:44.546640 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.546642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.546825 (+ 183us) server_negotiation.cc:407] Connection header received
0812 01:18:44.547311 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.547312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.547326 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.547393 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.548019 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.548661 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.550200 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.550412 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.550472 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.553047 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.553048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.553049 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.553057 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.554578 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.554977 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.554978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.554978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.555039 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.555295 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.555296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.555296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.555402 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.555468 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.555740 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.555820 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 01:18:44.556102 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.546529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:45811 (local address 127.0.0.1:36942)
0812 01:18:44.546687 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.546729 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:44.547193 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:44.547473 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:44.547476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:44.547744 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:44.547933 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.547937 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.548794 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.548795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.550081 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.550085 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.550504 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.550505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.550649 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.551156 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:44.551167 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:44.552942 (+ 1775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:44.554666 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.554675 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.554677 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.554899 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.555117 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.555118 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.555118 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.555225 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.555473 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:44.555481 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:44.555608 (+ 127us) client_negotiation.cc:769] Sending connection context
0812 01:18:44.555709 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 01:18:44.555854 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":80,"threads_started":1}
I20260812 01:18:44.556663 28224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.183.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.183.188@KRBTEST.COM" created.
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
I20260812 01:18:44.564631 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.556962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:33181 (local address 127.0.0.1:58368)
0812 01:18:44.557029 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.557038 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:44.557078 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:44.557365 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:44.557366 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:44.557515 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:44.557562 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.557563 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.558445 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.558446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.558930 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.558931 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.559420 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.559421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.559482 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.559808 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:44.559812 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:44.561385 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:44.563570 (+ 2185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.563571 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.563571 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.563732 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.563962 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.563962 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.563963 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.564025 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.564300 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:44.564301 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:44.564337 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 01:18:44.564398 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 01:18:44.564528 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 01:18:44.564699 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.557043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58368 (local address 127.17.183.189:33181)
0812 01:18:44.557231 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.557235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.557251 (+ 16us) server_negotiation.cc:407] Connection header received
0812 01:18:44.557268 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.557269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.557279 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.557365 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.557642 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.558360 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.559012 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.559330 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.559419 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.561493 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.561501 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.561501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.561508 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.563459 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.563808 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.563811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.563811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.563885 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.564093 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.564094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.564094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.564224 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.564307 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.564431 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.564579 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":163,"thread_start_us":113,"threads_started":1}
I20260812 01:18:44.565626 28224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:44.565971 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.565836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54494)
0812 01:18:44.565877 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.565934 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260812 01:18:44.566123 28134 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
I20260812 01:18:44.566540 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.566449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54506)
0812 01:18:44.566477 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.566508 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260812 01:18:44.566681 28224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:37971: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.183.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab.
Entry for principal kudu/127.17.183.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab.
I20260812 01:18:44.575305 18142 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskog5hhV/build/release/bin/kudu
/tmp/dist-test-taskog5hhV/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.188:37971
--webserver_interface=127.17.183.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab
--principal=kudu/127.17.183.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.183.148:40693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.183.190:45811,127.17.183.189:33181,127.17.183.188:37971
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:18:44.603940 28085 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } attempt: 3
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
I20260812 01:18:44.614322 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.604438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58374 (local address 127.17.183.189:33181)
0812 01:18:44.604539 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.604541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.604553 (+ 12us) server_negotiation.cc:407] Connection header received
0812 01:18:44.604612 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.604613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.604646 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.604717 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.605099 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.605605 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.606354 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.606616 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.606710 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.611634 (+ 4924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.611635 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.611636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.611651 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.613128 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.613529 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.613531 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.613531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.613594 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.613808 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.613809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.613810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.613928 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.614022 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.614148 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.614225 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 01:18:44.614323 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.604359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:33181 (local address 127.0.0.1:58374)
0812 01:18:44.604424 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.604441 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:44.604542 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:44.604753 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:44.604754 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:44.604920 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:44.604991 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.604993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.605699 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.605701 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.606228 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.606230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.606712 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.606714 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.606804 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.610135 (+ 3331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:44.610140 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:44.611454 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:44.613234 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.613235 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.613236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.613420 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.613663 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.613664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.613664 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.613734 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.613998 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:44.613999 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:44.614046 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 01:18:44.614118 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 01:18:44.614222 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 01:18:44.614705 28085 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:44.615089 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.614982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54520)
0812 01:18:44.615031 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.615059 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 01:18:44.615453 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.615366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54522)
0812 01:18:44.615412 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.615437 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 01:18:44.615600 28085 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:37971: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
I20260812 01:18:44.615909 28224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } attempt: 1
I20260812 01:18:44.616262 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.616127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54528)
0812 01:18:44.616185 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.616237 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 01:18:44.616710 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.616610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54536)
0812 01:18:44.616658 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.616685 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260812 01:18:44.616816 28224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:37971: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
I20260812 01:18:44.646765 28085 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } attempt: 1
I20260812 01:18:44.647192 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.647057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54542)
0812 01:18:44.647126 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.647163 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 01:18:44.647541 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.647450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54550)
0812 01:18:44.647493 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.647517 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 01:18:44.647652 28085 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:37971: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
W20260812 01:18:44.660133 28233 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:18:44.660372 28233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:18:44.660408 28233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:18:44.660449 28233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:18:44.661602 28233 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:18:44.661670 28233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:18:44.661697 28233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:18:44.661726 28233 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:18:44.661746 28233 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:18:44.663259 28233 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.183.148:40693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.183.190:45811,127.17.183.189:33181,127.17.183.188:37971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/krb5kdc/kudu_127.17.183.188.keytab
--principal=kudu/127.17.183.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.183.188:37971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.183.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 00:15:45 UTC on ccycloud.quasar-ehglva.root.comops.site
build id 4581748
I20260812 01:18:44.663547 28233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:18:44.663780 28233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:18:44.668535 28239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:44.668572 28244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:18:44.668629 28240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:18:44.668848 28233 server_base.cc:1034] running on GCE node
I20260812 01:18:44.669116 28233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:18:44.669437 28233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:18:44.670614 28233 hybrid_clock.cc:648] HybridClock initialized: now 1786497524670595 us; error 48 us; skew 500 ppm
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:18:44.673105 28233 init.cc:377] Logged in from keytab as kudu/127.17.183.188@KRBTEST.COM (short username kudu)
I20260812 01:18:44.673599 28233 webserver.cc:460] Webserver started at http://127.17.183.188:37565/ using document root <none> and password file <none>
I20260812 01:18:44.673822 28233 fs_manager.cc:359] Metadata directory not provided
I20260812 01:18:44.673887 28233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:18:44.674037 28233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:18:44.675099 28233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/data/instance:
uuid: "548961f56d794db1b7381366e2b016d7"
format_stamp: "Formatted at 2026-08-12 01:18:44 on dist-test-slave-rwrg"
server_key: "f927a11c4b6effab5fd210c21f51c37f"
server_key_iv: "386f4982b2f4b37fc2dcd5465f449deb"
server_key_version: "encryptionkey@0"
I20260812 01:18:44.675479 28233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/wal/instance:
uuid: "548961f56d794db1b7381366e2b016d7"
format_stamp: "Formatted at 2026-08-12 01:18:44 on dist-test-slave-rwrg"
server_key: "f927a11c4b6effab5fd210c21f51c37f"
server_key_iv: "386f4982b2f4b37fc2dcd5465f449deb"
server_key_version: "encryptionkey@0"
I20260812 01:18:44.676906 28233 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 01:18:44.677690 28260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:18:44.677861 28233 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 01:18:44.677971 28233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/data,/tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/wal
uuid: "548961f56d794db1b7381366e2b016d7"
format_stamp: "Formatted at 2026-08-12 01:18:44 on dist-test-slave-rwrg"
server_key: "f927a11c4b6effab5fd210c21f51c37f"
server_key_iv: "386f4982b2f4b37fc2dcd5465f449deb"
server_key_version: "encryptionkey@0"
I20260812 01:18:44.678048 28233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:18:44.684947 28224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } attempt: 2
I20260812 01:18:44.685417 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.685276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54562)
0812 01:18:44.685337 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.685374 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 01:18:44.685770 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.685678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54572)
0812 01:18:44.685721 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.685745 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 01:18:44.685859 28224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.183.188:37971: Network error: Client connection negotiation failed: client connection to 127.17.183.188:37971: connect: Connection refused (error 111)
I20260812 01:18:44.702888 28233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:18:44.705343 28233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:18:44.705505 28233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:18:44.709909 28233 rpc_server.cc:307] RPC server started. Bound to: 127.17.183.188:37971
I20260812 01:18:44.709945 28354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.183.188:37971 every 8 connection(s)
I20260812 01:18:44.710314 28233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/data/info.pb
I20260812 01:18:44.711197 28355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:18:44.712805 28355 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:44.720474 18142 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskog5hhV/build/release/bin/kudu as pid 28233
I20260812 01:18:44.720660 18142 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskog5hhV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786497235894345-18142-0/minicluster-data/master-2/wal/instance
I20260812 01:18:44.720906 18142 external_mini_cluster.cc:1428] Setting key d30d8b366144d58175f83ae8357be955
I20260812 01:18:44.721208 28090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.713535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36944 (local address 127.17.183.190:45811)
0812 01:18:44.713608 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.713611 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.713776 (+ 165us) server_negotiation.cc:407] Connection header received
0812 01:18:44.714230 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.714232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.714241 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.714293 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.714900 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.715354 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.716262 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.716426 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.716473 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.718566 (+ 2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.718567 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.718568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.718573 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.719765 (+ 1192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.720122 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.720123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.720123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.720184 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.720430 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.720432 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.720432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.720600 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.720684 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.721030 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.721119 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:18:44.721372 28360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.713508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.190:45811 (local address 127.0.0.1:36944)
0812 01:18:44.713658 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.713696 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:44.714154 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:44.714344 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:44.714347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:44.714592 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:44.714807 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.714811 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.715433 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.715434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.716191 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.716193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.716539 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.716540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.716645 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.717149 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:44.717157 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:44.718479 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:44.719841 (+ 1362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.719848 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.719849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.720059 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.720252 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.720252 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.720252 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.720348 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.720689 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:44.720696 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:44.720888 (+ 192us) client_negotiation.cc:769] Sending connection context
0812 01:18:44.720992 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 01:18:44.721139 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
I20260812 01:18:44.722075 28355 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:44.722766 28085 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } attempt: 2
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.190@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
I20260812 01:18:44.729928 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.722413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58380 (local address 127.17.183.189:33181)
0812 01:18:44.722464 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.722465 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.722475 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:18:44.722504 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.722505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.722514 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.722586 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.722886 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.723418 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.724279 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.724632 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.724712 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.726850 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.726852 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.726852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.726861 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.728523 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.729004 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.729006 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.729006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.729067 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.729328 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.729329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.729330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.729470 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.729519 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.729754 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.729836 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 01:18:44.730209 28360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.722331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.189:33181 (local address 127.0.0.1:58380)
0812 01:18:44.722379 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.722389 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:44.722422 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:44.722598 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:44.722599 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:44.722750 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:44.722794 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.722795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.723498 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.723499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.724194 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.724196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.724711 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.724712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.724783 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.725394 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:44.725399 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:44.726714 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:44.728619 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.728620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.728621 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.728907 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.729145 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.729146 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.729146 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.729208 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.729576 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:44.729576 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:44.729621 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 01:18:44.730019 (+ 398us) client_negotiation.cc:240] Negotiation successful
0812 01:18:44.730117 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 01:18:44.730594 28355 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:18:44.731876 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.722993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54586)
0812 01:18:44.723052 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.723061 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:44.723093 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:44.723644 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:44.723645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:44.723799 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:44.723833 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.723835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.724666 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.724667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.725364 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.725367 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.725921 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.725922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.726028 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.726425 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:44.726431 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:44.728135 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:44.730788 (+ 2653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.730789 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.730790 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.731011 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.731225 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.731226 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.731227 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.731315 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.731586 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:44.731587 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:44.731630 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 01:18:44.731690 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 01:18:44.731783 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 01:18:44.731904 28366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.723029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54586 (local address 127.17.183.188:37971)
0812 01:18:44.723518 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.723519 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.723525 (+ 6us) server_negotiation.cc:407] Connection header received
0812 01:18:44.723541 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.723542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.723549 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.723625 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.723912 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.724578 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.725440 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.725807 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.726183 (+ 376us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.728233 (+ 2050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.728242 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.728242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.728251 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.730681 (+ 2430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.731101 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.731104 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.731105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.731172 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.731364 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.731365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.731366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.731512 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.731606 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.731731 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.731808 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":72,"threads_started":1}
I20260812 01:18:44.732781 28364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.721286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54578 (local address 127.17.183.188:37971)
0812 01:18:44.721639 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.721643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.721658 (+ 15us) server_negotiation.cc:407] Connection header received
0812 01:18:44.721674 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.721676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.721710 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.721801 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.722612 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.723635 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.724541 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.725016 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.725119 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.728342 (+ 3223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.728343 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.728343 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.728350 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.731188 (+ 2838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.731573 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.731574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.731574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.731643 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.731834 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.731834 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.731835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.731936 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.732534 (+ 598us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.732574 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.732659 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":323,"thread_start_us":75,"threads_started":1}
I20260812 01:18:44.733738 28085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e: Bootstrap starting.
I20260812 01:18:44.734862 28085 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:44.735179 28085 log.cc:824] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e: Log is configured to *not* fsync() on all Append() calls
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.188@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
I20260812 01:18:44.736375 28085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e: No bootstrap required, opened a new log
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.190@KRBTEST.COM
I20260812 01:18:44.738821 28360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.730826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54598)
0812 01:18:44.730870 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.730880 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:44.730912 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:44.731140 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:44.731142 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:44.731292 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:44.731328 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.731329 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.732671 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.732672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.733365 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.733368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.734007 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.734008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.734059 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.734464 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:44.734470 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:44.735758 (+ 1288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:44.737624 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.737625 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.737626 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.737840 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.738073 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.738074 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.738075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.738130 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.738435 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:44.738436 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:44.738482 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 01:18:44.738561 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 01:18:44.738664 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 01:18:44.738996 28367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.730855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54598 (local address 127.17.183.188:37971)
0812 01:18:44.731002 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.731003 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.731009 (+ 6us) server_negotiation.cc:407] Connection header received
0812 01:18:44.731033 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.731033 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.731040 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.731119 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.731400 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.732590 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.733562 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.733913 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.733996 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.735836 (+ 1840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.735837 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.735838 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.735845 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.737532 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.737926 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.737928 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.737928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.737992 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.738195 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.738195 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.738196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.738340 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.738435 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.738606 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.738730 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260812 01:18:44.738822 28085 raft_consensus.cc:348] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } }
I20260812 01:18:44.739377 28085 raft_consensus.cc:729] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d39f25e72ca44a06afefac818075fe8e, State: Initialized, Role: FOLLOWER
I20260812 01:18:44.739476 28085 consensus_queue.cc:260] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } }
I20260812 01:18:44.739835 28085 sys_catalog.cc:564] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:44.740492 28355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7: Bootstrap starting.
I20260812 01:18:44.741276 28090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.733334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36960 (local address 127.17.183.190:45811)
0812 01:18:44.733370 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.733372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.733380 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:18:44.733447 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.733448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.733457 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.733523 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.734064 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.734655 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.735604 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.735878 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.735952 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.738398 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.738399 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.738400 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.738407 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.740047 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.740439 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.740440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.740440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.740528 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.740769 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.740770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.740771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.740883 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.741026 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.741100 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.741172 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 01:18:44.741343 28355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:44.741701 28355 log.cc:824] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7: Log is configured to *not* fsync() on all Append() calls
W20260812 01:18:44.741904 28394 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 01:18:44.742607 28355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7: No bootstrap required, opened a new log
I20260812 01:18:44.745239 28355 raft_consensus.cc:348] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } }
I20260812 01:18:44.745393 28355 raft_consensus.cc:729] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548961f56d794db1b7381366e2b016d7, State: Initialized, Role: FOLLOWER
I20260812 01:18:44.745481 28355 consensus_queue.cc:260] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } }
I20260812 01:18:44.745775 28355 sys_catalog.cc:564] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:44.743299 27970 master_runner.cc:186] Error getting master registration for 127.17.183.189:33181: OK, instance_id { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" instance_seqno: 1786497524541252 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:18:44.746497 27970 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 01:18:44.742055 28394 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.183.189@KRBTEST.COM
I20260812 01:18:44.747346 28373 sys_catalog.cc:455] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } } }
I20260812 01:18:44.747524 28373 sys_catalog.cc:458] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:44.747387 28398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } } }
I20260812 01:18:44.748018 28398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:44.751485 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.742001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58392 (local address 127.17.183.189:33181)
0812 01:18:44.742059 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.742061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.742068 (+ 7us) server_negotiation.cc:407] Connection header received
0812 01:18:44.742100 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.742101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.742112 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.742164 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.742820 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.743488 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.744488 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.744770 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.744815 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.747937 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.747939 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.747939 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.747947 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.749915 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.750306 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.750307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.750308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.750362 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.750556 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.750557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.750557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.750699 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.750870 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.751299 (+ 429us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.751385 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260812 01:18:44.747843 28420 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:18:44.751839 28420 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:18:44.749641 28233 master_runner.cc:186] Error getting master registration for 127.17.183.189:33181: OK, instance_id { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" instance_seqno: 1786497524541252 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:18:44.752166 28233 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:18:44.752915 18142 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:18:44.753872 28046 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d39f25e72ca44a06afefac818075fe8e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36960
I20260812 01:18:44.754015 28046 raft_consensus.cc:482] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 01:18:44.754068 28046 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:44.754762 28046 raft_consensus.cc:504] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } }
I20260812 01:18:44.754997 28046 leader_election.cc:288] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [CANDIDATE]: Term 1 election: Requested vote from peers f6d9b4f393e547c2941dc4314b9208cf (127.17.183.189:33181), 548961f56d794db1b7381366e2b016d7 (127.17.183.188:37971)
I20260812 01:18:44.755465 28309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d39f25e72ca44a06afefac818075fe8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "548961f56d794db1b7381366e2b016d7"
I20260812 01:18:44.755580 28309 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:44.756417 28309 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d39f25e72ca44a06afefac818075fe8e in term 1.
I20260812 01:18:44.757336 28000 leader_election.cc:302] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 548961f56d794db1b7381366e2b016d7, d39f25e72ca44a06afefac818075fe8e; no voters:
I20260812 01:18:44.757480 28373 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:18:44.757704 28373 raft_consensus.cc:686] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [term 1 LEADER]: Becoming Leader. State: Replica: d39f25e72ca44a06afefac818075fe8e, State: Running, Role: LEADER
I20260812 01:18:44.757802 28373 consensus_queue.cc:237] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } }
I20260812 01:18:44.758222 28373 sys_catalog.cc:455] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d39f25e72ca44a06afefac818075fe8e. Latest consensus state: current_term: 1 leader_uuid: "d39f25e72ca44a06afefac818075fe8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } } }
I20260812 01:18:44.758314 28373 sys_catalog.cc:458] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:44.761401 28434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:18:44.761623 28434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:18:44.764118 28309 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [term 1 FOLLOWER]: Refusing update from remote peer d39f25e72ca44a06afefac818075fe8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:44.764405 28373 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:44.765616 28398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d39f25e72ca44a06afefac818075fe8e. Latest consensus state: current_term: 1 leader_uuid: "d39f25e72ca44a06afefac818075fe8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } } }
I20260812 01:18:44.765699 28398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:44.767055 28090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.757354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36962 (local address 127.17.183.190:45811)
0812 01:18:44.757391 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.757393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.758139 (+ 746us) server_negotiation.cc:407] Connection header received
0812 01:18:44.758212 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.758213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.758224 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.758252 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.758967 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.759417 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.760364 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.760663 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.760729 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.763193 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.763194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.763194 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.763202 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.765264 (+ 2062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.765700 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.765701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.765701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.765773 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.766107 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.766108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.766108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.766347 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.766471 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.766899 (+ 428us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.766976 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 01:18:44.773806 28428 sys_catalog.cc:455] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d39f25e72ca44a06afefac818075fe8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } } }
I20260812 01:18:44.773923 28428 sys_catalog.cc:458] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:44.773928 28436 mvcc.cc:205] Tried to move back new op lower bound from 7317493861431136256 to 7317493861408727040. Current Snapshot: MvccSnapshot[applied={T|T < 7317493861431136256}]
I20260812 01:18:44.774389 28398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d39f25e72ca44a06afefac818075fe8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } } }
I20260812 01:18:44.774490 28398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:44.774695 28437 mvcc.cc:205] Tried to move back new op lower bound from 7317493861431136256 to 7317493861408727040. Current Snapshot: MvccSnapshot[applied={T|T < 7317493861431136256}]
I20260812 01:18:44.775190 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.757757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58402 (local address 127.17.183.189:33181)
0812 01:18:44.757863 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.757865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.764561 (+ 6696us) server_negotiation.cc:407] Connection header received
0812 01:18:44.764699 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.764700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.764740 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.764772 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.767000 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.767719 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.768939 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.769233 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.769292 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.770787 (+ 1495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.770788 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.770789 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.770796 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.772834 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.773634 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.773635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.773636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.773710 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.774382 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.774383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.774384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.774531 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.774624 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.775011 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.775094 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 01:18:44.776929 28224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } attempt: 3
I20260812 01:18:44.778743 28367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.757920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54610 (local address 127.17.183.188:37971)
0812 01:18:44.757963 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.757965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.765065 (+ 7100us) server_negotiation.cc:407] Connection header received
0812 01:18:44.765277 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.765278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.765303 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.765346 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.768930 (+ 3584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.769644 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.771516 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.771884 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.771931 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.775053 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.775055 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.775055 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.775062 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.776980 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.777675 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.777689 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.777689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.777746 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.778053 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.778054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.778054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.778193 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.778284 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.778564 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.778665 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 01:18:44 dist-test-slave-rwrg krb5kdc[27942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497524, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.183.189@KRBTEST.COM for kudu/127.17.183.188@KRBTEST.COM
I20260812 01:18:44.781781 28434 catalog_manager.cc:1347] Generated new cluster ID: 0ef47620f0164794ac32d5bbf5bafdf0
I20260812 01:18:44.781858 28434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:18:44.788137 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.777159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.183.188:37971 (local address 127.0.0.1:54618)
0812 01:18:44.777237 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0812 01:18:44.777247 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 01:18:44.777285 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:18:44.777532 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:18:44.777534 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:18:44.777701 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:18:44.777742 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.777745 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.778668 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.778669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.779411 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:18:44.779414 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.779923 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.779924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:18:44.779991 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.780437 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:18:44.780442 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:18:44.785345 (+ 4903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:18:44.787120 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.787121 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.787121 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.787328 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.787523 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:18:44.787524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:18:44.787524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:18:44.787589 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:18:44.787847 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:18:44.787848 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:18:44.787901 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 01:18:44.787957 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 01:18:44.788040 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 01:18:44.788801 28364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:44.777354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54618 (local address 127.17.183.188:37971)
0812 01:18:44.777398 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.777400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.777407 (+ 7us) server_negotiation.cc:407] Connection header received
0812 01:18:44.777426 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.777427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.777436 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.777491 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.777835 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.778548 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.779507 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:44.779810 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:44.779864 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:44.785449 (+ 5585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:18:44.785450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:18:44.785450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:18:44.785458 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:18:44.787035 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.787393 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.787394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.787394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.787452 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:18:44.787654 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:18:44.787655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:18:44.787655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:18:44.787786 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:18:44.787843 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:44.788607 (+ 764us) server_negotiation.cc:299] Negotiation successful
0812 01:18:44.788699 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 01:18:44.790287 28224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf: Bootstrap starting.
I20260812 01:18:44.791076 28224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf: Neither blocks nor log segments found. Creating new log.
I20260812 01:18:44.791388 28224 log.cc:824] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf: Log is configured to *not* fsync() on all Append() calls
I20260812 01:18:44.801308 28224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf: No bootstrap required, opened a new log
I20260812 01:18:44.803257 28224 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } }
I20260812 01:18:44.803375 28224 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d9b4f393e547c2941dc4314b9208cf, State: Initialized, Role: FOLLOWER
I20260812 01:18:44.803442 28224 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } }
I20260812 01:18:44.803750 28224 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:18:44.804688 28183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d39f25e72ca44a06afefac818075fe8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f6d9b4f393e547c2941dc4314b9208cf"
I20260812 01:18:44.804785 28183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:18:44.805567 28183 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d39f25e72ca44a06afefac818075fe8e in term 1.
I20260812 01:18:44.805985 28181 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [term 1 FOLLOWER]: Refusing update from remote peer d39f25e72ca44a06afefac818075fe8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:18:44.806272 28373 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:18:44.808602 28447 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d39f25e72ca44a06afefac818075fe8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } } }
I20260812 01:18:44.809839 28447 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:44.809939 28447 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader d39f25e72ca44a06afefac818075fe8e. Latest consensus state: current_term: 1 leader_uuid: "d39f25e72ca44a06afefac818075fe8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } } }
I20260812 01:18:44.810058 28447 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:18:44.810163 28447 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d39f25e72ca44a06afefac818075fe8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } } }
I20260812 01:18:44.810264 28447 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf [sys.catalog]: This master's current role is: FOLLOWER
W20260812 01:18:44.811249 28467 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:18:44.811334 28467 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:18:44.812379 28455 mvcc.cc:205] Tried to move back new op lower bound from 7317493861431136256 to 7317493861408727040. Current Snapshot: MvccSnapshot[applied={T|T < 7317493861431136256}]
I20260812 01:18:44.814581 28428 sys_catalog.cc:455] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d39f25e72ca44a06afefac818075fe8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39f25e72ca44a06afefac818075fe8e" member_type: VOTER last_known_addr { host: "127.17.183.190" port: 45811 } } peers { permanent_uuid: "f6d9b4f393e547c2941dc4314b9208cf" member_type: VOTER last_known_addr { host: "127.17.183.189" port: 33181 } } peers { permanent_uuid: "548961f56d794db1b7381366e2b016d7" member_type: VOTER last_known_addr { host: "127.17.183.188" port: 37971 } } }
I20260812 01:18:44.814687 28428 sys_catalog.cc:458] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e [sys.catalog]: This master's current role is: LEADER
I20260812 01:18:44.822293 28434 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:18:44.823064 28434 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:18:44.833506 28434 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d39f25e72ca44a06afefac818075fe8e: Generated new TSK 0
I20260812 01:18:44.833714 28434 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 01:18:44.860905 28090 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:44.859228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36978 (local address 127.17.183.190:45811)
0812 01:18:44.859277 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.859279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.860158 (+ 879us) server_negotiation.cc:407] Connection header received
0812 01:18:44.860274 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.860275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.860286 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.860317 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.860833 (+ 516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36978: BlockingRecv error: recv got EOF from 127.0.0.1:36978 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 01:18:44.861829 28229 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:44.859622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58416 (local address 127.17.183.189:33181)
0812 01:18:44.859662 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.859664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.861332 (+ 1668us) server_negotiation.cc:407] Connection header received
0812 01:18:44.861428 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.861429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.861441 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.861469 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.861771 (+ 302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58416: BlockingRecv error: recv got EOF from 127.0.0.1:58416 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 01:18:44.862679 28364 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:44.859899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54632 (local address 127.17.183.188:37971)
0812 01:18:44.859938 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.859940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.862170 (+ 2230us) server_negotiation.cc:407] Connection header received
0812 01:18:44.862282 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.862283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.862294 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.862324 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.862621 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54632: BlockingRecv error: recv got EOF from 127.0.0.1:54632 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 01:18:44.865126 28229 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:44.864316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58428 (local address 127.17.183.189:33181)
0812 01:18:44.864350 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.864352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.864575 (+ 223us) server_negotiation.cc:407] Connection header received
0812 01:18:44.864678 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.864679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.864697 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.864725 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.865043 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58428: BlockingRecv error: recv got EOF from 127.0.0.1:58428 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 01:18:44.868175 28229 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:44.867417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58436 (local address 127.17.183.189:33181)
0812 01:18:44.867465 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.867466 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.867693 (+ 227us) server_negotiation.cc:407] Connection header received
0812 01:18:44.867784 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.867785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.867794 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.867823 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.868132 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58436: BlockingRecv error: recv got EOF from 127.0.0.1:58436 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260812 01:18:44.872110 28229 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:44.871424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58446 (local address 127.17.183.189:33181)
0812 01:18:44.871455 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.871456 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.871654 (+ 198us) server_negotiation.cc:407] Connection header received
0812 01:18:44.871742 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.871743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.871752 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.871780 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.872055 (+ 275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58446: BlockingRecv error: recv got EOF from 127.0.0.1:58446 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 01:18:44.878129 28229 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:44.877343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58456 (local address 127.17.183.189:33181)
0812 01:18:44.877378 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.877380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.877617 (+ 237us) server_negotiation.cc:407] Connection header received
0812 01:18:44.877715 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.877716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.877726 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.877755 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.878070 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58456: BlockingRecv error: recv got EOF from 127.0.0.1:58456 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 01:18:44.888620 28229 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:44.887428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58460 (local address 127.17.183.189:33181)
0812 01:18:44.887471 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.887473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.888058 (+ 585us) server_negotiation.cc:407] Connection header received
0812 01:18:44.888161 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.888162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.888174 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.888203 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.888559 (+ 356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58460: BlockingRecv error: recv got EOF from 127.0.0.1:58460 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 01:18:44.906948 28229 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:44.905935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58472 (local address 127.17.183.189:33181)
0812 01:18:44.905982 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.905984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.906300 (+ 316us) server_negotiation.cc:407] Connection header received
0812 01:18:44.906414 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.906416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.906428 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.906460 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.906888 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58472: BlockingRecv error: recv got EOF from 127.0.0.1:58472 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 01:18:44.941438 28229 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:44.940396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58480 (local address 127.17.183.189:33181)
0812 01:18:44.940444 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:44.940446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:44.940801 (+ 355us) server_negotiation.cc:407] Connection header received
0812 01:18:44.940912 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:44.940913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:44.940928 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:44.940958 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:44.941376 (+ 418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58480: BlockingRecv error: recv got EOF from 127.0.0.1:58480 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 01:18:45.007733 28229 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:45.006948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58486 (local address 127.17.183.189:33181)
0812 01:18:45.007016 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:45.007018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:45.007120 (+ 102us) server_negotiation.cc:407] Connection header received
0812 01:18:45.007180 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:45.007181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:45.007192 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:45.007273 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:45.007658 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58486: BlockingRecv error: recv got EOF from 127.0.0.1:58486 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 01:18:45.137735 28229 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:45.137002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58488 (local address 127.17.183.189:33181)
0812 01:18:45.137057 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:45.137060 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:45.137170 (+ 110us) server_negotiation.cc:407] Connection header received
0812 01:18:45.137236 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:45.137237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:45.137247 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:45.137289 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:45.137643 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58488: BlockingRecv error: recv got EOF from 127.0.0.1:58488 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260812 01:18:45.395694 28229 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:18:45.395145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58494 (local address 127.17.183.189:33181)
0812 01:18:45.395221 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:45.395223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:45.395233 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:18:45.395260 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:45.395260 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:45.395270 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:45.395322 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:18:45.395648 (+ 326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58494: BlockingRecv error: recv got EOF from 127.0.0.1:58494 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 01:18:45.752483 28420 catalog_manager.cc:1259] Loaded cluster ID: 0ef47620f0164794ac32d5bbf5bafdf0
I20260812 01:18:45.752611 28420 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7: loading cluster ID for follower catalog manager: success
I20260812 01:18:45.753427 28420 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7: acquiring CA information for follower catalog manager: success
I20260812 01:18:45.753752 28420 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 548961f56d794db1b7381366e2b016d7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:18:45.811825 28467 catalog_manager.cc:1259] Loaded cluster ID: 0ef47620f0164794ac32d5bbf5bafdf0
I20260812 01:18:45.811897 28467 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf: loading cluster ID for follower catalog manager: success
I20260812 01:18:45.812844 28467 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf: acquiring CA information for follower catalog manager: success
I20260812 01:18:45.813177 28467 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f6d9b4f393e547c2941dc4314b9208cf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:18:45.911482 28588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:45.909042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58496 (local address 127.17.183.189:33181)
0812 01:18:45.909152 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:45.909154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:45.909165 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:18:45.909198 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:45.909199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:45.909267 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:45.909358 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:45.909511 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:45.910014 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:45.910800 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:45.910989 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:45.911043 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:45.911179 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:45.911295 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:45.911355 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:45.911396 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 01:18:45.911415 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":63,"threads_started":1}
I20260812 01:18:45.915810 28596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:45.913593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54644 (local address 127.17.183.188:37971)
0812 01:18:45.913717 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:45.913719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:45.913729 (+ 10us) server_negotiation.cc:407] Connection header received
0812 01:18:45.913806 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:45.913807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:45.913842 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:45.913917 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:45.914014 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:45.914515 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:45.915163 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:45.915346 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:45.915393 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:45.915534 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:45.915630 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:45.915684 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:45.915730 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 01:18:45.915748 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":79,"threads_started":1}
I20260812 01:18:45.920468 28596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:45.917853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54648 (local address 127.17.183.188:37971)
0812 01:18:45.917914 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:45.917916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:45.917927 (+ 11us) server_negotiation.cc:407] Connection header received
0812 01:18:45.917954 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:45.917955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:45.917965 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:45.918021 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:45.918174 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:45.918699 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:45.919678 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:45.919959 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:45.920025 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:45.920178 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:45.920209 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:45.920268 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:45.920371 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 01:18:45.920392 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 01:18:45.920832 28608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:45.917475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36992 (local address 127.17.183.190:45811)
0812 01:18:45.917704 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:45.917706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:45.917714 (+ 8us) server_negotiation.cc:407] Connection header received
0812 01:18:45.917760 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:45.917761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:45.917800 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:45.917892 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:45.918051 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:45.918863 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:45.919710 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:45.920021 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:45.920083 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:45.920339 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:45.920433 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:45.920487 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:45.920746 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 01:18:45.920777 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":73,"threads_started":1}
I20260812 01:18:45.920871 28588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:18:45.917654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58508 (local address 127.17.183.189:33181)
0812 01:18:45.917718 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 01:18:45.917720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 01:18:45.918054 (+ 334us) server_negotiation.cc:407] Connection header received
0812 01:18:45.918158 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:18:45.918159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:18:45.918171 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:18:45.918222 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:18:45.918340 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:45.919025 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:45.919941 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:18:45.920231 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:18:45.920309 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:18:45.920493 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:18:45.920547 (+ 54us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:18:45.920592 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 01:18:45.920750 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 01:18:45.920775 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 01:18:45.922942 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 27970
I20260812 01:18:45.934842 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 28097
I20260812 01:18:45.951408 18142 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskog5hhV/build/release/bin/kudu with pid 28233
2026-08-12T01:18:45Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3186 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6305 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (290071 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST